[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:02 dist-test-slave-qg60 krb5kdc[23075](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:02 dist-test-slave-qg60 krb5kdc[23075](info): set up 2 sockets
Aug 10 03:45:02 dist-test-slave-qg60 krb5kdc[23075](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 03:45:03.251055 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.008s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:03 dist-test-slave-qg60 krb5kdc[23075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:03.392836 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38387
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:03.534346 23092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:03.534710 23092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:03.534801 23092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:03.539290 23092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:03.539397 23092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:03.539438 23092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:03.539480 23092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:03.539520 23092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:03.546701 23092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:03.548391 23092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:03.549934 23092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:03.568241 23100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:03.569820 23098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:03.569878 23097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:03.569983 23092 server_base.cc:1034] running on GCE node
I20260810 03:45:03.570767 23092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:03.572628 23092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:03.573889 23092 hybrid_clock.cc:648] HybridClock initialized: now 1786333503573855 us; error 87 us; skew 500 ppm
Aug 10 03:45:03 dist-test-slave-qg60 krb5kdc[23075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333503, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:03.577569 23092 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:03.578768 23092 webserver.cc:460] Webserver started at http://127.22.134.254:43747/ using document root <none> and password file <none>
I20260810 03:45:03.579659 23092 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:03.579735 23092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:03.580112 23092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:03.582856 23092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "c2ff858e924645489e44076466c86dbe"
format_stamp: "Formatted at 2026-08-10 03:45:03 on dist-test-slave-qg60"
server_key: "f6eaeb289ad55843a352a47bec12e2e2"
server_key_iv: "3a7e6a3fb8189051a15babcc9a076ae3"
server_key_version: "encryptionkey@0"
I20260810 03:45:03.583518 23092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "c2ff858e924645489e44076466c86dbe"
format_stamp: "Formatted at 2026-08-10 03:45:03 on dist-test-slave-qg60"
server_key: "f6eaeb289ad55843a352a47bec12e2e2"
server_key_iv: "3a7e6a3fb8189051a15babcc9a076ae3"
server_key_version: "encryptionkey@0"
I20260810 03:45:03.588567 23092 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260810 03:45:03.591899 23108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:03.593658 23092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:03.593869 23092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "c2ff858e924645489e44076466c86dbe"
format_stamp: "Formatted at 2026-08-10 03:45:03 on dist-test-slave-qg60"
server_key: "f6eaeb289ad55843a352a47bec12e2e2"
server_key_iv: "3a7e6a3fb8189051a15babcc9a076ae3"
server_key_version: "encryptionkey@0"
I20260810 03:45:03.594019 23092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:03.608901 23092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:03.613662 23092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:03.613977 23092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:03.630187 23092 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:38387
I20260810 03:45:03.630234 23165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:38387 every 8 connection(s)
I20260810 03:45:03.631506 23092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:03.636358 23166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:03.641688 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 23092
I20260810 03:45:03.641880 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:03.643356 23067 external_mini_cluster.cc:1428] Setting key dcc0c102b0ff726989788e51c638c8c8
I20260810 03:45:03.646222 23166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe: Bootstrap starting.
I20260810 03:45:03.650718 23166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:03.651916 23166 log.cc:824] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:03.655779 23166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe: No bootstrap required, opened a new log
I20260810 03:45:03.662057 23166 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ff858e924645489e44076466c86dbe" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38387 } }
I20260810 03:45:03.662433 23166 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:03.662559 23166 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff858e924645489e44076466c86dbe, State: Initialized, Role: FOLLOWER
I20260810 03:45:03.663407 23166 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ff858e924645489e44076466c86dbe" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38387 } }
I20260810 03:45:03.663668 23166 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:03.663810 23166 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:03.663978 23166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:03.665452 23166 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ff858e924645489e44076466c86dbe" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38387 } }
I20260810 03:45:03.666188 23166 leader_election.cc:302] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2ff858e924645489e44076466c86dbe; no voters:
I20260810 03:45:03.666694 23166 leader_election.cc:288] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:03.666853 23171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:03.667112 23171 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [term 1 LEADER]: Becoming Leader. State: Replica: c2ff858e924645489e44076466c86dbe, State: Running, Role: LEADER
I20260810 03:45:03.667577 23171 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ff858e924645489e44076466c86dbe" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38387 } }
Aug 10 03:45:03 dist-test-slave-qg60 krb5kdc[23075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:03.668540 23166 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:03.669492 23173 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2ff858e924645489e44076466c86dbe. Latest consensus state: current_term: 1 leader_uuid: "c2ff858e924645489e44076466c86dbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ff858e924645489e44076466c86dbe" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38387 } } }
I20260810 03:45:03.669628 23173 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:03.671849 23172 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2ff858e924645489e44076466c86dbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2ff858e924645489e44076466c86dbe" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38387 } } }
I20260810 03:45:03.672020 23172 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:03.672214 23178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:03.677856 23178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:03.678506 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:03.649931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57016 (local address 127.22.134.254:38387)
0810 03:45:03.650399 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:03.650413 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:03.650483 (+ 70us) server_negotiation.cc:407] Connection header received
0810 03:45:03.654830 (+ 4347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:03.654848 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:03.655261 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:03.655550 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:03.659304 (+ 3754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:03.660383 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:03.662234 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:03.662919 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:03.663067 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:03.668877 (+ 5810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:03.668919 (+ 42us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:03.668935 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:03.668990 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:03.673747 (+ 4757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:03.674649 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:03.674654 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:03.674658 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:03.674781 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:03.675291 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:03.675294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:03.675296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:03.675820 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:03.676077 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:03.676724 (+ 647us) server_negotiation.cc:299] Negotiation successful
0810 03:45:03.677069 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":155,"threads_started":1}
I20260810 03:45:03.686203 23178 catalog_manager.cc:1347] Generated new cluster ID: 88fe48f425d84a1bbbff49af114d0ad4
I20260810 03:45:03.686291 23178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:03.698088 23178 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:03.700212 23178 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:03.715847 23178 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2ff858e924645489e44076466c86dbe: Generated new TSK 0
I20260810 03:45:03.717448 23178 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:03.767999 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38387
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:03.911171 23195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:03.911530 23195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:03.911618 23195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:03.916195 23195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:03.916297 23195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:03.916395 23195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:03.922219 23195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38387
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:03.923429 23195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:03.924566 23195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:03.935286 23200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:03.935299 23201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:03.935356 23203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:03.935779 23195 server_base.cc:1034] running on GCE node
I20260810 03:45:03.936267 23195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:03.937012 23195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:03.938205 23195 hybrid_clock.cc:648] HybridClock initialized: now 1786333503938164 us; error 55 us; skew 500 ppm
Aug 10 03:45:03 dist-test-slave-qg60 krb5kdc[23075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333503, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:03.941484 23195 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:03.942490 23195 webserver.cc:460] Webserver started at http://127.22.134.193:37907/ using document root <none> and password file <none>
I20260810 03:45:03.943060 23195 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:03.943122 23195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:03.943300 23195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:03.945574 23195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "634884f89fed4366ac7fa0b4dd22cffb"
format_stamp: "Formatted at 2026-08-10 03:45:03 on dist-test-slave-qg60"
server_key: "e96ced2f2b2eb6c8a0a85ebf66d7110b"
server_key_iv: "bfaff769199491bd85d40f05588494fd"
server_key_version: "encryptionkey@0"
I20260810 03:45:03.946123 23195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "634884f89fed4366ac7fa0b4dd22cffb"
format_stamp: "Formatted at 2026-08-10 03:45:03 on dist-test-slave-qg60"
server_key: "e96ced2f2b2eb6c8a0a85ebf66d7110b"
server_key_iv: "bfaff769199491bd85d40f05588494fd"
server_key_version: "encryptionkey@0"
I20260810 03:45:03.950101 23195 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:03.953006 23211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:03.954329 23195 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:45:03.954475 23195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "634884f89fed4366ac7fa0b4dd22cffb"
format_stamp: "Formatted at 2026-08-10 03:45:03 on dist-test-slave-qg60"
server_key: "e96ced2f2b2eb6c8a0a85ebf66d7110b"
server_key_iv: "bfaff769199491bd85d40f05588494fd"
server_key_version: "encryptionkey@0"
I20260810 03:45:03.954607 23195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:03.978385 23195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:03.981896 23195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:03.982132 23195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:03.982856 23195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:03.983964 23195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:03.984040 23195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:03.984127 23195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:03.984171 23195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:03.999150 23195 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:41757
I20260810 03:45:03.999177 23336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:41757 every 8 connection(s)
I20260810 03:45:04.000202 23195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:04.007685 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 23195
I20260810 03:45:04.007810 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:04.008206 23067 external_mini_cluster.cc:1428] Setting key c346c70501049ce28a8274954cfd3b21
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333503, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:04.017321 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:04.003013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:55297 (local address 127.22.134.254:38387)
0810 03:45:04.003239 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:04.003243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:04.004555 (+ 1312us) server_negotiation.cc:407] Connection header received
0810 03:45:04.005660 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:04.005664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:04.005717 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:04.005813 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:04.007231 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.008066 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.009817 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.010060 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.010188 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:04.013260 (+ 3072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:04.013264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:04.013267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:04.013300 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:04.014991 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.015569 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.015572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.015574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.015667 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.016032 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.016035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.016037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.016254 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:04.016364 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:04.016978 (+ 614us) server_negotiation.cc:299] Negotiation successful
0810 03:45:04.017135 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260810 03:45:04.018250 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:04.003367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38387 (local address 127.22.134.193:55297)
0810 03:45:04.004378 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:04.004425 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:04.005411 (+ 986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:04.005984 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:04.005991 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:04.006506 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:04.007053 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:04.007076 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.008250 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.008253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:04.009641 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:04.009653 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.010236 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.010240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:04.010469 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:04.011218 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:04.011236 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:04.013069 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:04.015119 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:04.015126 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:04.015146 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:04.015450 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:04.015764 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:04.015767 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:04.015769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:04.015924 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:04.016374 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:04.016383 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:04.016665 (+ 282us) client_negotiation.cc:769] Sending connection context
0810 03:45:04.016918 (+ 253us) client_negotiation.cc:240] Negotiation successful
0810 03:45:04.017288 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"thread_start_us":225,"threads_started":1}
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:04.019738 23337 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38387
I20260810 03:45:04.020017 23337 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:04.020646 23337 heartbeater.cc:511] Master 127.22.134.254:38387 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:45:04.023064 23125 ts_manager.cc:194] Registered new tserver with Master: 634884f89fed4366ac7fa0b4dd22cffb (127.22.134.193:41757)
I20260810 03:45:04.025089 23125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:55297
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:04.045341 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38387
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:04.185029 23343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:04.185309 23343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:04.185356 23343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:04.189437 23343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:04.189500 23343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:04.189561 23343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:04.195202 23343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38387
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:04.196310 23343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:04.197418 23343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:04.208515 23349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:04.208608 23343 server_base.cc:1034] running on GCE node
W20260810 03:45:04.208653 23351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:04.208817 23348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:04.209281 23343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:04.209950 23343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:04.211165 23343 hybrid_clock.cc:648] HybridClock initialized: now 1786333504211128 us; error 54 us; skew 500 ppm
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333504, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:04.214304 23343 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:04.215221 23343 webserver.cc:460] Webserver started at http://127.22.134.194:39607/ using document root <none> and password file <none>
I20260810 03:45:04.215751 23343 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:04.215811 23343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:04.216085 23343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:04.218401 23343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "62e3ea2ff71048a08f42ac4391557ee9"
format_stamp: "Formatted at 2026-08-10 03:45:04 on dist-test-slave-qg60"
server_key: "20ec8ee405cc7b9dbf7b1701f36aa2f3"
server_key_iv: "c4a23d325f5597d954674498e7e6b1da"
server_key_version: "encryptionkey@0"
I20260810 03:45:04.219058 23343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "62e3ea2ff71048a08f42ac4391557ee9"
format_stamp: "Formatted at 2026-08-10 03:45:04 on dist-test-slave-qg60"
server_key: "20ec8ee405cc7b9dbf7b1701f36aa2f3"
server_key_iv: "c4a23d325f5597d954674498e7e6b1da"
server_key_version: "encryptionkey@0"
I20260810 03:45:04.223167 23343 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:04.225769 23358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:04.227018 23343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:04.227203 23343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "62e3ea2ff71048a08f42ac4391557ee9"
format_stamp: "Formatted at 2026-08-10 03:45:04 on dist-test-slave-qg60"
server_key: "20ec8ee405cc7b9dbf7b1701f36aa2f3"
server_key_iv: "c4a23d325f5597d954674498e7e6b1da"
server_key_version: "encryptionkey@0"
I20260810 03:45:04.227319 23343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:04.251154 23343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:04.254590 23343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:04.254829 23343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:04.255522 23343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:04.256403 23343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:04.256451 23343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:04.256517 23343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:04.256551 23343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:04.270852 23343 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:45807
I20260810 03:45:04.270910 23481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:45807 every 8 connection(s)
I20260810 03:45:04.271899 23343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:04.273679 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 23343
I20260810 03:45:04.273798 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:04.274099 23067 external_mini_cluster.cc:1428] Setting key 0ac6a4ce2fe651b795513d2bd94088d9
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333504, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:45:04.286830 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:04.274427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:54087 (local address 127.22.134.254:38387)
0810 03:45:04.274758 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:04.274761 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:04.275590 (+ 829us) server_negotiation.cc:407] Connection header received
0810 03:45:04.276564 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:04.276570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:04.276634 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:04.276753 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:04.277981 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.278518 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.279679 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.279913 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.280028 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:04.282914 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:04.282917 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:04.282920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:04.282943 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:04.284518 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.285146 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.285149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.285150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.285227 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.285635 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.285638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.285639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.285827 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:04.285940 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:04.286465 (+ 525us) server_negotiation.cc:299] Negotiation successful
0810 03:45:04.286650 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237}
I20260810 03:45:04.287627 23484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:04.274567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38387 (local address 127.22.134.194:54087)
0810 03:45:04.275432 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:04.275485 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:04.276344 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:04.276943 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:04.276950 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:04.277330 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:04.277833 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:04.277847 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.278673 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.278677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:04.279550 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:04.279560 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.280066 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.280070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:04.280247 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:04.280905 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:04.280922 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:04.282736 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:04.284642 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:04.284648 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:04.284664 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:04.284999 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:04.285327 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:04.285331 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:04.285333 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:04.285517 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:04.285940 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:04.285948 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:04.286215 (+ 267us) client_negotiation.cc:769] Sending connection context
0810 03:45:04.286405 (+ 190us) client_negotiation.cc:240] Negotiation successful
0810 03:45:04.286762 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":219,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
I20260810 03:45:04.289070 23482 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38387
I20260810 03:45:04.289348 23482 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:04.289880 23482 heartbeater.cc:511] Master 127.22.134.254:38387 requested a full tablet report, sending...
I20260810 03:45:04.291035 23125 ts_manager.cc:194] Registered new tserver with Master: 62e3ea2ff71048a08f42ac4391557ee9 (127.22.134.194:45807)
I20260810 03:45:04.291658 23125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:54087
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:04.308405 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38387
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:04.457854 23488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:04.458148 23488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:04.458225 23488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:04.462530 23488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:04.462608 23488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:04.462677 23488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:04.468437 23488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38387
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:04.469744 23488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:04.470860 23488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:04.481719 23494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:04.481747 23495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:04.481775 23497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:04.482024 23488 server_base.cc:1034] running on GCE node
I20260810 03:45:04.482589 23488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:04.483345 23488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:04.484510 23488 hybrid_clock.cc:648] HybridClock initialized: now 1786333504484493 us; error 31 us; skew 500 ppm
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333504, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:04.487695 23488 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:04.488656 23488 webserver.cc:460] Webserver started at http://127.22.134.195:39585/ using document root <none> and password file <none>
I20260810 03:45:04.489310 23488 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:04.489410 23488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:04.489656 23488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:04.491773 23488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "153e45fc8f36435a954f5f5a75635b77"
format_stamp: "Formatted at 2026-08-10 03:45:04 on dist-test-slave-qg60"
server_key: "15a149e5cc12a202f0b6efee1e195d33"
server_key_iv: "6ff416b0f12d8f3ca99c53385b929b16"
server_key_version: "encryptionkey@0"
I20260810 03:45:04.492358 23488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "153e45fc8f36435a954f5f5a75635b77"
format_stamp: "Formatted at 2026-08-10 03:45:04 on dist-test-slave-qg60"
server_key: "15a149e5cc12a202f0b6efee1e195d33"
server_key_iv: "6ff416b0f12d8f3ca99c53385b929b16"
server_key_version: "encryptionkey@0"
I20260810 03:45:04.496423 23488 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 03:45:04.499172 23504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:04.500517 23488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 03:45:04.500667 23488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "153e45fc8f36435a954f5f5a75635b77"
format_stamp: "Formatted at 2026-08-10 03:45:04 on dist-test-slave-qg60"
server_key: "15a149e5cc12a202f0b6efee1e195d33"
server_key_iv: "6ff416b0f12d8f3ca99c53385b929b16"
server_key_version: "encryptionkey@0"
I20260810 03:45:04.500869 23488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:04.518755 23488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:04.522331 23488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:04.522622 23488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:04.523409 23488 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:04.524403 23488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:04.524493 23488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:04.524577 23488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:04.524636 23488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:04.539744 23488 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:36197
I20260810 03:45:04.539775 23626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:36197 every 8 connection(s)
I20260810 03:45:04.541109 23488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:04.546852 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 23488
I20260810 03:45:04.546968 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:04.547263 23067 external_mini_cluster.cc:1428] Setting key 3f8b63cfe6388828da9cc5c434337719
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333504, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:04.557127 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:04.543511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:56379 (local address 127.22.134.254:38387)
0810 03:45:04.543669 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:04.543673 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:04.544906 (+ 1233us) server_negotiation.cc:407] Connection header received
0810 03:45:04.545869 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:04.545872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:04.545921 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:04.546003 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:04.547812 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.548722 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.550258 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.550527 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.550659 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:04.553644 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:04.553647 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:04.553649 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:04.553676 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:04.554914 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.555477 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.555481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.555483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.555575 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.555927 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.555932 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.555934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.556144 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:04.556257 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:04.556801 (+ 544us) server_negotiation.cc:299] Negotiation successful
0810 03:45:04.556934 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:45:04.558211 23629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:04.543869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38387 (local address 127.22.134.195:56379)
0810 03:45:04.544682 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:04.544798 (+ 116us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:04.545680 (+ 882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:04.546228 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:04.546236 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:04.546832 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:04.547618 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:04.547637 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.548930 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.548936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:04.550106 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:04.550119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.550709 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.550714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:04.550946 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:04.551603 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:04.551622 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:04.553426 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:04.555041 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:04.555048 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:04.555067 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:04.555364 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:04.555673 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:04.555678 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:04.555679 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:04.555826 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:04.556255 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:04.556262 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:04.556521 (+ 259us) client_negotiation.cc:769] Sending connection context
0810 03:45:04.556727 (+ 206us) client_negotiation.cc:240] Negotiation successful
0810 03:45:04.557097 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":157,"threads_started":1}
I20260810 03:45:04.559650 23627 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38387
I20260810 03:45:04.559922 23627 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:04.560446 23627 heartbeater.cc:511] Master 127.22.134.254:38387 requested a full tablet report, sending...
I20260810 03:45:04.561656 23125 ts_manager.cc:194] Registered new tserver with Master: 153e45fc8f36435a954f5f5a75635b77 (127.22.134.195:36197)
I20260810 03:45:04.562350 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:45:04.562372 23125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:56379
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333504, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333504, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:04.591332 23634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:04.581555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52054 (local address 127.22.134.193:41757)
0810 03:45:04.581903 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:04.581909 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:04.582015 (+ 106us) server_negotiation.cc:407] Connection header received
0810 03:45:04.582164 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:04.582169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:04.582402 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:04.582527 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:04.583271 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.584002 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.584918 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.585296 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.585377 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:04.587866 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:04.587875 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:04.587888 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:04.587911 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:04.589589 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.589990 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.589995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.589996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.590075 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.590380 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.590382 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.590383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.590612 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:04.590765 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:04.590950 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 03:45:04.591075 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":148,"threads_started":1}
W20260810 03:45:04.592447 23242 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52054
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:04.622905 23634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:04.613859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52066 (local address 127.22.134.193:41757)
0810 03:45:04.614028 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:04.614033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:04.614204 (+ 171us) server_negotiation.cc:407] Connection header received
0810 03:45:04.614317 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:04.614320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:04.614364 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:04.614436 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:04.615197 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.615684 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.616712 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:04.616990 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:04.617072 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:04.619778 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:04.619781 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:04.619782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:04.619805 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:04.621371 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.621771 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.621773 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.621775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.621846 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:04.622123 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:04.622125 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:04.622126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:04.622289 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:04.622390 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:04.622671 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 03:45:04.622778 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:45:04.624172 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 23195
I20260810 03:45:04.633324 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 23343
I20260810 03:45:04.641673 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 23488
I20260810 03:45:04.651899 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 23092
2026-08-10T03:45:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2562 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23641](info): set up 2 sockets
Aug 10 03:45:04 dist-test-slave-qg60 krb5kdc[23641](info): commencing operation
krb5kdc: starting...
W20260810 03:45:05.835191 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:05 dist-test-slave-qg60 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:05.972837 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38489
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:06.089550 23655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:06.089879 23655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:06.089963 23655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:06.094038 23655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:06.094146 23655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:06.094195 23655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:06.094233 23655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:06.094267 23655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:06.099839 23655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:06.101018 23655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:06.102073 23655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:06.111645 23662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:06.111739 23660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:06.111769 23665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:06.111949 23655 server_base.cc:1034] running on GCE node
I20260810 03:45:06.112591 23655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:06.113822 23655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:06.115015 23655 hybrid_clock.cc:648] HybridClock initialized: now 1786333506114994 us; error 41 us; skew 500 ppm
Aug 10 03:45:06 dist-test-slave-qg60 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333506, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:06.118366 23655 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:06.119457 23655 webserver.cc:460] Webserver started at http://127.22.134.254:42693/ using document root <none> and password file <none>
I20260810 03:45:06.120149 23655 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:06.120253 23655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:06.120527 23655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:06.122834 23655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "8ff5cf942cbc4060957222aad920e7cc"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "f0b5cc6ce6a0bafb662ebc77f4b882e8"
server_key_iv: "0ee652f09566e836093462925b7a8e78"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.123548 23655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "8ff5cf942cbc4060957222aad920e7cc"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "f0b5cc6ce6a0bafb662ebc77f4b882e8"
server_key_iv: "0ee652f09566e836093462925b7a8e78"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.127718 23655 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:45:06.130306 23672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.131610 23655 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:06.131749 23655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "8ff5cf942cbc4060957222aad920e7cc"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "f0b5cc6ce6a0bafb662ebc77f4b882e8"
server_key_iv: "0ee652f09566e836093462925b7a8e78"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.131865 23655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:06.162344 23655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:06.165556 23655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:06.165796 23655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:06.173774 23655 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:38489
I20260810 03:45:06.173812 23727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:38489 every 8 connection(s)
I20260810 03:45:06.174809 23655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:06.178000 23728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:06.181126 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 23655
I20260810 03:45:06.181231 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:06.181495 23067 external_mini_cluster.cc:1428] Setting key da9fe646cc8a90d14c04965dde92a8c2
I20260810 03:45:06.184298 23728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc: Bootstrap starting.
I20260810 03:45:06.187096 23728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:06.187929 23728 log.cc:824] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:06.190160 23728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc: No bootstrap required, opened a new log
Aug 10 03:45:06 dist-test-slave-qg60 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:06.194630 23728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff5cf942cbc4060957222aad920e7cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38489 } }
I20260810 03:45:06.194923 23728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:06.195066 23728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff5cf942cbc4060957222aad920e7cc, State: Initialized, Role: FOLLOWER
I20260810 03:45:06.195605 23728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff5cf942cbc4060957222aad920e7cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38489 } }
I20260810 03:45:06.195767 23728 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:06.195834 23728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:06.195940 23728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:06.197225 23728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff5cf942cbc4060957222aad920e7cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38489 } }
I20260810 03:45:06.197595 23728 leader_election.cc:302] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ff5cf942cbc4060957222aad920e7cc; no voters:
I20260810 03:45:06.197944 23728 leader_election.cc:288] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:06.198128 23733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:06.198431 23733 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [term 1 LEADER]: Becoming Leader. State: Replica: 8ff5cf942cbc4060957222aad920e7cc, State: Running, Role: LEADER
I20260810 03:45:06.198462 23731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.183014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49036 (local address 127.22.134.254:38489)
0810 03:45:06.183471 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:06.183491 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:06.183535 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:45:06.184346 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:06.184372 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:06.184836 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:06.185194 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:06.185913 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.187395 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.188286 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.188903 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.189078 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.191782 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:06.191788 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:06.191805 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:06.191835 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:06.194912 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.195461 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.195466 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.195470 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.195587 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.195905 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.195908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.195910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.196450 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:06.196658 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:06.197080 (+ 422us) server_negotiation.cc:299] Negotiation successful
0810 03:45:06.197399 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":127,"threads_started":1}
I20260810 03:45:06.198822 23733 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff5cf942cbc4060957222aad920e7cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38489 } }
I20260810 03:45:06.199254 23728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:06.200721 23734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ff5cf942cbc4060957222aad920e7cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff5cf942cbc4060957222aad920e7cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38489 } } }
I20260810 03:45:06.200944 23734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:06.200943 23735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ff5cf942cbc4060957222aad920e7cc. Latest consensus state: current_term: 1 leader_uuid: "8ff5cf942cbc4060957222aad920e7cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff5cf942cbc4060957222aad920e7cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38489 } } }
I20260810 03:45:06.201262 23735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc [sys.catalog]: This master's current role is: LEADER
W20260810 03:45:06.204316 23752 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:06.204411 23752 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:06.204535 23749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:06.205571 23749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:06.210754 23749 catalog_manager.cc:1347] Generated new cluster ID: 7c1c762e2c8243d7bc10d427e1791a84
I20260810 03:45:06.210870 23749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:06.228637 23749 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:06.229650 23749 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:06.234263 23749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ff5cf942cbc4060957222aad920e7cc: Generated new TSK 0
I20260810 03:45:06.234937 23749 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:06.272661 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38489
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:06.389714 23758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:06.389990 23758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:06.390094 23758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:06.394327 23758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:06.394393 23758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:06.394491 23758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:06.401729 23758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38489
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:06.402845 23758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:06.403918 23758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:06.413900 23767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:06.413887 23764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:06.413880 23765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:06.413938 23758 server_base.cc:1034] running on GCE node
I20260810 03:45:06.414610 23758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:06.415206 23758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:06.416373 23758 hybrid_clock.cc:648] HybridClock initialized: now 1786333506416355 us; error 29 us; skew 500 ppm
Aug 10 03:45:06 dist-test-slave-qg60 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333506, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:06.419433 23758 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:06.420341 23758 webserver.cc:460] Webserver started at http://127.22.134.193:34357/ using document root <none> and password file <none>
I20260810 03:45:06.421036 23758 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:06.421120 23758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:06.421344 23758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:06.423533 23758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "3fc01e25fe44415284384bd28c86e63a"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "89b7b1f738ede6946acba09acfdba3cb"
server_key_iv: "e931d9ad6098e900d53d44642a7de865"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.424178 23758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "3fc01e25fe44415284384bd28c86e63a"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "89b7b1f738ede6946acba09acfdba3cb"
server_key_iv: "e931d9ad6098e900d53d44642a7de865"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.428192 23758 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:45:06.431015 23775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.432339 23758 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 03:45:06.432507 23758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "3fc01e25fe44415284384bd28c86e63a"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "89b7b1f738ede6946acba09acfdba3cb"
server_key_iv: "e931d9ad6098e900d53d44642a7de865"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.432636 23758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:06.451910 23758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:06.455259 23758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:06.455480 23758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:06.456100 23758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:06.457008 23758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:06.457079 23758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.457151 23758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:06.457193 23758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.466363 23758 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:34823
I20260810 03:45:06.466383 23894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:34823 every 8 connection(s)
I20260810 03:45:06.467304 23758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:06.470058 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 23758
I20260810 03:45:06.470178 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:06.470460 23067 external_mini_cluster.cc:1428] Setting key a39d9bdd12c7ccbe40e18ab0e5f189e1
Aug 10 03:45:06 dist-test-slave-qg60 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333506, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:06.482932 23731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.469230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:54633 (local address 127.22.134.254:38489)
0810 03:45:06.469372 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:06.469375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:06.470448 (+ 1073us) server_negotiation.cc:407] Connection header received
0810 03:45:06.472469 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:06.472472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:06.472524 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:06.472598 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:06.473886 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.474433 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.475602 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.475839 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.475957 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.479022 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:06.479033 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:06.479035 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:06.479060 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:06.480634 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.481261 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.481265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.481267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.481355 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.481732 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.481735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.481737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.481958 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:06.482068 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:06.482602 (+ 534us) server_negotiation.cc:299] Negotiation successful
0810 03:45:06.482750 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:45:06.483908 23899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.469569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38489 (local address 127.22.134.193:54633)
0810 03:45:06.470256 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:06.470317 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:06.472243 (+ 1926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:06.472825 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:06.472834 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:06.473215 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:06.473726 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.473741 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.474576 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.474579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.475472 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.475482 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.476003 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.476007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.476191 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.476972 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:06.476989 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:06.478833 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:06.480780 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:06.480789 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:06.480808 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:06.481154 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:06.481461 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:06.481464 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:06.481466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:06.481620 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:06.482066 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:06.482074 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:06.482353 (+ 279us) client_negotiation.cc:769] Sending connection context
0810 03:45:06.482547 (+ 194us) client_negotiation.cc:240] Negotiation successful
0810 03:45:06.482914 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":159,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:45:06.485352 23896 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38489
I20260810 03:45:06.485626 23896 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:06.486156 23896 heartbeater.cc:511] Master 127.22.134.254:38489 requested a full tablet report, sending...
I20260810 03:45:06.488129 23686 ts_manager.cc:194] Registered new tserver with Master: 3fc01e25fe44415284384bd28c86e63a (127.22.134.193:34823)
I20260810 03:45:06.489842 23686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:54633
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:06.504480 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38489
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:06.618611 23902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:06.618922 23902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:06.619009 23902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:06.623358 23902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:06.623461 23902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:06.623559 23902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:06.628980 23902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38489
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:06.630127 23902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:06.631225 23902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:06.641045 23907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:06.641121 23910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:06.641121 23908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:06.641233 23902 server_base.cc:1034] running on GCE node
I20260810 03:45:06.641652 23902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:06.642354 23902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:06.643574 23902 hybrid_clock.cc:648] HybridClock initialized: now 1786333506643559 us; error 31 us; skew 500 ppm
Aug 10 03:45:06 dist-test-slave-qg60 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333506, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:06.646713 23902 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:06.647656 23902 webserver.cc:460] Webserver started at http://127.22.134.194:38227/ using document root <none> and password file <none>
I20260810 03:45:06.648214 23902 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:06.648275 23902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:06.648442 23902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:06.650600 23902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "668482ae8d49405982cb57c258e55004"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "4b44f03543a50a46565d1301ed408a46"
server_key_iv: "d1864ef5fc73a1180205ac009791fda4"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.651232 23902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "668482ae8d49405982cb57c258e55004"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "4b44f03543a50a46565d1301ed408a46"
server_key_iv: "d1864ef5fc73a1180205ac009791fda4"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.655179 23902 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:06.657732 23917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.659021 23902 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260810 03:45:06.659166 23902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "668482ae8d49405982cb57c258e55004"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "4b44f03543a50a46565d1301ed408a46"
server_key_iv: "d1864ef5fc73a1180205ac009791fda4"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.659267 23902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:06.671942 23902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:06.675328 23902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:06.675482 23902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:06.676002 23902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:06.676818 23902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:06.676865 23902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.676905 23902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:06.676927 23902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.686311 23902 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:42999
I20260810 03:45:06.686358 24038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:42999 every 8 connection(s)
I20260810 03:45:06.687254 23902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:06.691686 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 23902
I20260810 03:45:06.691843 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:06.692185 23067 external_mini_cluster.cc:1428] Setting key 616eda1f698f206c7c77392bc76aa06c
Aug 10 03:45:06 dist-test-slave-qg60 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333506, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:45:06.703819 23731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.689332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:48001 (local address 127.22.134.254:38489)
0810 03:45:06.689508 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:06.689512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:06.690400 (+ 888us) server_negotiation.cc:407] Connection header received
0810 03:45:06.692184 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:06.692188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:06.692297 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:06.692440 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:06.694053 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.694618 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.695881 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.696140 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.696265 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.699445 (+ 3180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:06.699448 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:06.699451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:06.699479 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:06.701330 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.702052 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.702055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.702057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.702150 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.702566 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.702571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.702573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.702786 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:06.702906 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:06.703486 (+ 580us) server_negotiation.cc:299] Negotiation successful
0810 03:45:06.703632 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:45:06.704856 24041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.689690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38489 (local address 127.22.134.194:48001)
0810 03:45:06.690236 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:06.690283 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:06.691829 (+ 1546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:06.692645 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:06.692652 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:06.693193 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:06.693827 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.693844 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.694761 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.694767 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.695739 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.695749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.696306 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.696310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.696500 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.697214 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:06.697232 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:06.699228 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:06.701480 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:06.701486 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:06.701504 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:06.701920 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:06.702262 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:06.702265 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:06.702268 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:06.702450 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:06.702915 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:06.702925 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:06.703206 (+ 281us) client_negotiation.cc:769] Sending connection context
0810 03:45:06.703435 (+ 229us) client_negotiation.cc:240] Negotiation successful
0810 03:45:06.703810 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":133,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
I20260810 03:45:06.706300 24039 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38489
I20260810 03:45:06.706573 24039 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:06.707096 24039 heartbeater.cc:511] Master 127.22.134.254:38489 requested a full tablet report, sending...
I20260810 03:45:06.708374 23686 ts_manager.cc:194] Registered new tserver with Master: 668482ae8d49405982cb57c258e55004 (127.22.134.194:42999)
I20260810 03:45:06.709290 23686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:48001
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:06.724885 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38489
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:06.842519 24044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:06.842805 24044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:06.842852 24044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:06.846963 24044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:06.847043 24044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:06.847122 24044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:06.853410 24044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38489
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:06.854604 24044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:06.855695 24044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:06.866986 24052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:06.867060 24044 server_base.cc:1034] running on GCE node
W20260810 03:45:06.866947 24050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:06.867019 24049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:06.867684 24044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:06.868398 24044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:06.869592 24044 hybrid_clock.cc:648] HybridClock initialized: now 1786333506869489 us; error 114 us; skew 500 ppm
Aug 10 03:45:06 dist-test-slave-qg60 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333506, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:06.872500 24044 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:06.873538 24044 webserver.cc:460] Webserver started at http://127.22.134.195:39529/ using document root <none> and password file <none>
I20260810 03:45:06.874156 24044 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:06.874256 24044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:06.874501 24044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:06.876610 24044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "362f8c8ef8104c3fae170a63f872c0af"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "c02e67f3aaada54491fd3a3ac7905293"
server_key_iv: "3698e9c428a010075dc6c346b2a5ea75"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.877269 24044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "362f8c8ef8104c3fae170a63f872c0af"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "c02e67f3aaada54491fd3a3ac7905293"
server_key_iv: "3698e9c428a010075dc6c346b2a5ea75"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.881359 24044 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:45:06.884169 24061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.885602 24044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:06.885773 24044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "362f8c8ef8104c3fae170a63f872c0af"
format_stamp: "Formatted at 2026-08-10 03:45:06 on dist-test-slave-qg60"
server_key: "c02e67f3aaada54491fd3a3ac7905293"
server_key_iv: "3698e9c428a010075dc6c346b2a5ea75"
server_key_version: "encryptionkey@0"
I20260810 03:45:06.885898 24044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:06.896241 24044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:06.899592 24044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:06.899798 24044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:06.900511 24044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:06.901434 24044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:06.901513 24044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.901577 24044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:06.901607 24044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:06.917272 24044 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:35683
I20260810 03:45:06.917341 24182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:35683 every 8 connection(s)
I20260810 03:45:06.918262 24044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:06.922495 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 24044
I20260810 03:45:06.922626 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:06.922901 23067 external_mini_cluster.cc:1428] Setting key ea044dd980878f6ebbd71010edba78b9
Aug 10 03:45:06 dist-test-slave-qg60 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333506, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:06.933672 23731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.920440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35729 (local address 127.22.134.254:38489)
0810 03:45:06.920634 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:06.920638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:06.921577 (+ 939us) server_negotiation.cc:407] Connection header received
0810 03:45:06.923408 (+ 1831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:06.923412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:06.923475 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:06.923600 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:06.925283 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.925849 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.927071 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.927286 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.927374 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.930192 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:06.930195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:06.930197 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:06.930223 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:06.931632 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.932144 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.932146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.932148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.932232 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.932566 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.932569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.932570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.932843 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:06.932930 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:06.933399 (+ 469us) server_negotiation.cc:299] Negotiation successful
0810 03:45:06.933509 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 03:45:06.934460 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.920866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38489 (local address 127.22.134.195:35729)
0810 03:45:06.921388 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:06.921436 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:06.923170 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:06.923804 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:06.923814 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:06.924384 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:06.925123 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.925141 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.925974 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.925977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.926945 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.926955 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.927420 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.927422 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.927587 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.928269 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:06.928286 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:06.930024 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:06.931746 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:06.931751 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:06.931763 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:06.932035 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:06.932311 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:06.932313 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:06.932315 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:06.932439 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:06.932935 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:06.932940 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:06.933161 (+ 221us) client_negotiation.cc:769] Sending connection context
0810 03:45:06.933318 (+ 157us) client_negotiation.cc:240] Negotiation successful
0810 03:45:06.933560 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":131,"threads_started":1}
I20260810 03:45:06.935891 24183 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38489
I20260810 03:45:06.936189 24183 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:06.936905 24183 heartbeater.cc:511] Master 127.22.134.254:38489 requested a full tablet report, sending...
I20260810 03:45:06.937969 23686 ts_manager.cc:194] Registered new tserver with Master: 362f8c8ef8104c3fae170a63f872c0af (127.22.134.195:35683)
I20260810 03:45:06.938567 23686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:35729
I20260810 03:45:06.949132 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:45:06.962666 23731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.954082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.22.134.254:38489)
0810 03:45:06.954300 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:06.954305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:06.954502 (+ 197us) server_negotiation.cc:407] Connection header received
0810 03:45:06.954721 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:06.954725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:06.954785 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:06.954884 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:06.955787 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.956375 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.957336 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.957592 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.957716 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.959201 (+ 1485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:06.959206 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:06.959209 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:06.959244 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:06.960628 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.961146 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.961152 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.961154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.961245 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:06.961597 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:06.961601 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:06.961604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:06.961855 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:06.962030 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:06.962323 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 03:45:06.962478 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 03:45:06.968855 23686 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49050:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:06.972182 23686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:06.989055 24198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.982282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35702 (local address 127.22.134.195:35683)
0810 03:45:06.983637 (+ 1355us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:06.983675 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:06.983704 (+ 29us) server_negotiation.cc:407] Connection header received
0810 03:45:06.983842 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:06.983848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:06.984100 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:06.984326 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:06.984693 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.985728 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.987344 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.988252 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.988376 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.988576 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:06.988782 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 03:45:06.988883 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1231,"thread_start_us":244,"threads_started":1}
I20260810 03:45:06.989086 24197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.982213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:42999 (local address 127.0.0.1:39916)
0810 03:45:06.983221 (+ 1008us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:06.983239 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:06.983368 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:06.984452 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:06.984455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:06.984473 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:06.984682 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.984692 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.986679 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.986685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.987622 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.987632 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.988660 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.988667 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.988803 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.988826 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:45:06.988878 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 03:45:06.988933 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":11,"thread_start_us":182,"threads_started":1}
I20260810 03:45:06.989086 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.982097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:35683 (local address 127.0.0.1:35702)
0810 03:45:06.983102 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:06.983155 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:06.983286 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:06.984313 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:06.984320 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:06.984344 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:06.984543 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.984552 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.985888 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.985895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.987219 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.987228 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.988401 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.988406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.988525 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.988591 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 03:45:06.988715 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 03:45:06.988881 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":36,"thread_start_us":117,"threads_started":1}
I20260810 03:45:06.990232 24200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.982905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39916 (local address 127.22.134.194:42999)
0810 03:45:06.983634 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:06.983682 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:06.983955 (+ 273us) server_negotiation.cc:407] Connection header received
0810 03:45:06.984050 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:06.984055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:06.984240 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:06.985037 (+ 797us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:06.985247 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.986456 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.987775 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.988495 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.989751 (+ 1256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.989896 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:06.989948 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 03:45:06.990053 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":282,"threads_started":1}
I20260810 03:45:06.990257 24199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.982910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:34823 (local address 127.0.0.1:60026)
0810 03:45:06.983903 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:06.983918 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:06.984046 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:06.984559 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:06.984562 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:06.984582 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:06.984683 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.984689 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.986244 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.986247 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.988395 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:06.988405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.989881 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.989885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:06.989967 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.989988 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 03:45:06.990058 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 03:45:06.990122 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"thread_start_us":138,"threads_started":1}
I20260810 03:45:06.990721 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:06.983399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60026 (local address 127.22.134.193:34823)
0810 03:45:06.983800 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:06.983842 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:06.984043 (+ 201us) server_negotiation.cc:407] Connection header received
0810 03:45:06.984154 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:06.984158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:06.984325 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:06.984486 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:06.984819 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.986102 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.988546 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:06.989561 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:06.989693 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:06.989816 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:06.990469 (+ 653us) server_negotiation.cc:299] Negotiation successful
0810 03:45:06.990577 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":102,"threads_started":1}
I20260810 03:45:06.992767 24111 tablet_service.cc:1467] Processing CreateTablet for tablet e7c3778052334830812a5ae27eeda4fd (DEFAULT_TABLE table=test-table [id=b61bc459748f45f093774643f3956e69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:06.993357 23824 tablet_service.cc:1467] Processing CreateTablet for tablet e7c3778052334830812a5ae27eeda4fd (DEFAULT_TABLE table=test-table [id=b61bc459748f45f093774643f3956e69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:06.993286 23968 tablet_service.cc:1467] Processing CreateTablet for tablet e7c3778052334830812a5ae27eeda4fd (DEFAULT_TABLE table=test-table [id=b61bc459748f45f093774643f3956e69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:06.994056 24111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c3778052334830812a5ae27eeda4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:06.994448 23824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c3778052334830812a5ae27eeda4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:06.994448 23968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c3778052334830812a5ae27eeda4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:07.001834 24202 tablet_bootstrap.cc:492] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af: Bootstrap starting.
I20260810 03:45:07.003500 24203 tablet_bootstrap.cc:492] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a: Bootstrap starting.
I20260810 03:45:07.004052 24204 tablet_bootstrap.cc:492] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004: Bootstrap starting.
I20260810 03:45:07.005203 24202 tablet_bootstrap.cc:654] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:07.007313 24203 tablet_bootstrap.cc:654] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:07.007499 24202 log.cc:824] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:07.008045 24204 tablet_bootstrap.cc:654] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:07.008800 24203 log.cc:824] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:07.009426 24204 log.cc:824] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:07.010501 24202 tablet_bootstrap.cc:492] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af: No bootstrap required, opened a new log
I20260810 03:45:07.010785 24202 ts_tablet_manager.cc:1397] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260810 03:45:07.011595 24203 tablet_bootstrap.cc:492] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a: No bootstrap required, opened a new log
I20260810 03:45:07.011842 24204 tablet_bootstrap.cc:492] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004: No bootstrap required, opened a new log
I20260810 03:45:07.011852 24203 ts_tablet_manager.cc:1397] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260810 03:45:07.012113 24204 ts_tablet_manager.cc:1397] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 03:45:07.016542 24203 raft_consensus.cc:348] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.016942 24203 raft_consensus.cc:374] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:07.017040 24203 raft_consensus.cc:729] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc01e25fe44415284384bd28c86e63a, State: Initialized, Role: FOLLOWER
I20260810 03:45:07.016991 24202 raft_consensus.cc:348] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.017442 24202 raft_consensus.cc:374] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:07.017554 24202 raft_consensus.cc:729] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 362f8c8ef8104c3fae170a63f872c0af, State: Initialized, Role: FOLLOWER
I20260810 03:45:07.017638 24203 consensus_queue.cc:260] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.018191 24202 consensus_queue.cc:260] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.018244 24204 raft_consensus.cc:348] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.018630 24204 raft_consensus.cc:374] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:07.018756 24204 raft_consensus.cc:729] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 668482ae8d49405982cb57c258e55004, State: Initialized, Role: FOLLOWER
I20260810 03:45:07.018790 24203 ts_tablet_manager.cc:1428] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:45:07.019238 24183 heartbeater.cc:503] Master 127.22.134.254:38489 was elected leader, sending a full tablet report...
I20260810 03:45:07.019239 23896 heartbeater.cc:503] Master 127.22.134.254:38489 was elected leader, sending a full tablet report...
I20260810 03:45:07.019376 24202 ts_tablet_manager.cc:1428] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af: Time spent starting tablet: real 0.008s user 0.003s sys 0.006s
I20260810 03:45:07.019807 24204 consensus_queue.cc:260] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.020663 24204 ts_tablet_manager.cc:1428] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260810 03:45:07.020771 24039 heartbeater.cc:503] Master 127.22.134.254:38489 was elected leader, sending a full tablet report...
W20260810 03:45:07.169482 24184 tablet.cc:2369] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:07.177178 24210 raft_consensus.cc:482] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:07.177423 24210 raft_consensus.cc:504] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.178848 24210 leader_election.cc:288] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 362f8c8ef8104c3fae170a63f872c0af (127.22.134.195:35683), 3fc01e25fe44415284384bd28c86e63a (127.22.134.193:34823)
I20260810 03:45:07.183844 24041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:07.179210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:35683 (local address 127.22.134.194:35617)
0810 03:45:07.179368 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:07.179385 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:07.179494 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:07.179859 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:07.179862 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:07.179886 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:07.180042 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:07.180049 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.181216 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.181220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:07.182506 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:07.182517 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.183321 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.183325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:07.183453 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:07.183514 (+ 61us) client_negotiation.cc:769] Sending connection context
0810 03:45:07.183596 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 03:45:07.183676 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 03:45:07.183992 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:07.179895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:46457 (local address 127.22.134.193:34823)
0810 03:45:07.180050 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:07.180057 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:07.180074 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:45:07.180158 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:07.180161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:07.180209 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:07.180297 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:07.180603 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.181363 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.182777 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.183398 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.183535 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:07.183595 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:07.183795 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 03:45:07.183871 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:07.184173 24198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:07.179355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:35617 (local address 127.22.134.195:35683)
0810 03:45:07.179497 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:07.179502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:07.179519 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:45:07.179590 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:07.179593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:07.179638 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:07.179720 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:07.180181 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.181088 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.182678 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.183178 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.183333 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:07.183394 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:07.183931 (+ 537us) server_negotiation.cc:299] Negotiation successful
0810 03:45:07.184013 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 03:45:07.184325 24211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:07.179543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:34823 (local address 127.22.134.194:46457)
0810 03:45:07.179853 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:07.179868 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:07.179985 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:07.180317 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:07.180319 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:07.180337 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:07.180458 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:07.180464 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.181498 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.181504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:07.182538 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:07.182549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.183542 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.183549 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:07.183664 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:07.183685 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 03:45:07.183763 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 03:45:07.183821 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":97,"threads_started":1}
I20260810 03:45:07.185252 24132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c3778052334830812a5ae27eeda4fd" candidate_uuid: "668482ae8d49405982cb57c258e55004" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "362f8c8ef8104c3fae170a63f872c0af" is_pre_election: true
I20260810 03:45:07.185300 23845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c3778052334830812a5ae27eeda4fd" candidate_uuid: "668482ae8d49405982cb57c258e55004" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc01e25fe44415284384bd28c86e63a" is_pre_election: true
I20260810 03:45:07.185679 23845 raft_consensus.cc:2454] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 668482ae8d49405982cb57c258e55004 in term 0.
I20260810 03:45:07.186370 23920 leader_election.cc:302] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc01e25fe44415284384bd28c86e63a, 668482ae8d49405982cb57c258e55004; no voters:
I20260810 03:45:07.186697 24210 raft_consensus.cc:2781] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:07.186779 24210 raft_consensus.cc:482] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:07.186816 24210 raft_consensus.cc:3037] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:07.187599 24132 raft_consensus.cc:2454] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 668482ae8d49405982cb57c258e55004 in term 0.
W20260810 03:45:07.188544 24040 tablet.cc:2369] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:07.188617 24210 raft_consensus.cc:504] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.189059 24210 leader_election.cc:288] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [CANDIDATE]: Term 1 election: Requested vote from peers 362f8c8ef8104c3fae170a63f872c0af (127.22.134.195:35683), 3fc01e25fe44415284384bd28c86e63a (127.22.134.193:34823)
I20260810 03:45:07.189503 24132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c3778052334830812a5ae27eeda4fd" candidate_uuid: "668482ae8d49405982cb57c258e55004" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "362f8c8ef8104c3fae170a63f872c0af"
I20260810 03:45:07.189566 23845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c3778052334830812a5ae27eeda4fd" candidate_uuid: "668482ae8d49405982cb57c258e55004" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fc01e25fe44415284384bd28c86e63a"
I20260810 03:45:07.189649 24132 raft_consensus.cc:3037] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:07.189689 23845 raft_consensus.cc:3037] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:07.191308 23845 raft_consensus.cc:2454] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 668482ae8d49405982cb57c258e55004 in term 1.
I20260810 03:45:07.191352 24132 raft_consensus.cc:2454] T e7c3778052334830812a5ae27eeda4fd P 362f8c8ef8104c3fae170a63f872c0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 668482ae8d49405982cb57c258e55004 in term 1.
I20260810 03:45:07.191686 23920 leader_election.cc:302] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 362f8c8ef8104c3fae170a63f872c0af, 668482ae8d49405982cb57c258e55004; no voters:
I20260810 03:45:07.191880 24210 raft_consensus.cc:2781] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:07.192113 24210 raft_consensus.cc:686] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [term 1 LEADER]: Becoming Leader. State: Replica: 668482ae8d49405982cb57c258e55004, State: Running, Role: LEADER
I20260810 03:45:07.192402 24210 consensus_queue.cc:237] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } }
I20260810 03:45:07.196218 23688 catalog_manager.cc:5495] T e7c3778052334830812a5ae27eeda4fd P 668482ae8d49405982cb57c258e55004 reported cstate change: term changed from 0 to 1, leader changed from <none> to 668482ae8d49405982cb57c258e55004 (127.22.134.194). New cstate: current_term: 1 leader_uuid: "668482ae8d49405982cb57c258e55004" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f8c8ef8104c3fae170a63f872c0af" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "668482ae8d49405982cb57c258e55004" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 42999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fc01e25fe44415284384bd28c86e63a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34823 } health_report { overall_health: UNKNOWN } } }
W20260810 03:45:07.218744 23898 tablet.cc:2369] T e7c3778052334830812a5ae27eeda4fd P 3fc01e25fe44415284384bd28c86e63a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 03:45:07 dist-test-slave-qg60 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:07.241420 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:07.222694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60032 (local address 127.22.134.193:34823)
0810 03:45:07.222873 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:07.222880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:07.223096 (+ 216us) server_negotiation.cc:407] Connection header received
0810 03:45:07.223218 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:07.223220 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:07.223264 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:07.223336 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:07.224154 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.224664 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.225716 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.225940 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.226053 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:07.237480 (+ 11427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:07.237501 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:07.237516 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:07.237551 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:07.239459 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:07.239970 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:07.239976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:07.239978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:07.240069 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:07.240370 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:07.240373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:07.240375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:07.240650 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:07.240906 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:07.241118 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 03:45:07.241248 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
Aug 10 03:45:07 dist-test-slave-qg60 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:45:07 dist-test-slave-qg60 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:07.272800 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:07.263354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60038 (local address 127.22.134.193:34823)
0810 03:45:07.263532 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:07.263538 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:07.263710 (+ 172us) server_negotiation.cc:407] Connection header received
0810 03:45:07.263824 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:07.263826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:07.263870 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:07.263943 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:07.264627 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.265322 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.266347 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.266587 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.266681 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:07.269446 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:07.269451 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:07.269453 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:07.269477 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:07.270953 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:07.271421 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:07.271424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:07.271425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:07.271527 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:07.271838 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:07.271840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:07.271841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:07.272017 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:07.272127 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:07.272431 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 03:45:07.272561 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 10 03:45:07 dist-test-slave-qg60 krb5kdc[23641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:45:07 dist-test-slave-qg60 krb5kdc[23641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:07.305274 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:07.295368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60042 (local address 127.22.134.193:34823)
0810 03:45:07.295549 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:07.295555 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:07.295786 (+ 231us) server_negotiation.cc:407] Connection header received
0810 03:45:07.295908 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:07.295911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:07.295959 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:07.296041 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:07.296823 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.297368 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.298277 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:07.298504 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:07.298593 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:07.301762 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:07.301766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:07.301768 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:07.301795 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:07.303269 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:07.303766 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:07.303769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:07.303770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:07.303851 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:07.304276 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:07.304279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:07.304281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:07.304472 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:07.304586 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:07.304914 (+ 328us) server_negotiation.cc:299] Negotiation successful
0810 03:45:07.305086 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260810 03:45:07.307116 23804 tablet_service.cc:2908] Rejecting scan request for tablet e7c3778052334830812a5ae27eeda4fd: Uninitialized: clean time has not yet been initialized
I20260810 03:45:07.309715 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 23758
I20260810 03:45:07.318502 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 23902
I20260810 03:45:07.326050 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 24044
I20260810 03:45:07.337311 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 23655
2026-08-10T03:45:07Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2685 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:07 dist-test-slave-qg60 krb5kdc[24226](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:07 dist-test-slave-qg60 krb5kdc[24226](info): set up 2 sockets
Aug 10 03:45:07 dist-test-slave-qg60 krb5kdc[24226](info): commencing operation
krb5kdc: starting...
W20260810 03:45:08.512811 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:08 dist-test-slave-qg60 krb5kdc[24226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:08.648453 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35523
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:35523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:08.765267 24240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:08.765574 24240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:08.765672 24240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:08.769833 24240 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:08.769922 24240 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 03:45:08.769954 24240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:08.769996 24240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:08.770033 24240 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:08.770064 24240 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:08.775679 24240 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:35523
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:08.776842 24240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:08.777947 24240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:08.786851 24245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:08.786985 24240 server_base.cc:1034] running on GCE node
W20260810 03:45:08.786854 24246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:08.786854 24248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:08.787904 24240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:08.789080 24240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:08.790287 24240 hybrid_clock.cc:648] HybridClock initialized: now 1786333508790264 us; error 33 us; skew 500 ppm
Aug 10 03:45:08 dist-test-slave-qg60 krb5kdc[24226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333508, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:08.793257 24240 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:08.794247 24240 webserver.cc:460] Webserver started at http://127.22.134.254:42895/ using document root <none> and password file <none>
I20260810 03:45:08.794905 24240 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:08.795006 24240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:08.795261 24240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:08.797544 24240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "7ec16bc8a5434375b4eab170d53c3913"
format_stamp: "Formatted at 2026-08-10 03:45:08 on dist-test-slave-qg60"
server_key: "2f08c5edbbd1bc17237c4f7b94814678"
server_key_iv: "b0c43a4991a422a1a61a53a38528be25"
server_key_version: "encryptionkey@0"
I20260810 03:45:08.798257 24240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "7ec16bc8a5434375b4eab170d53c3913"
format_stamp: "Formatted at 2026-08-10 03:45:08 on dist-test-slave-qg60"
server_key: "2f08c5edbbd1bc17237c4f7b94814678"
server_key_iv: "b0c43a4991a422a1a61a53a38528be25"
server_key_version: "encryptionkey@0"
I20260810 03:45:08.802383 24240 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:08.805069 24257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:08.806453 24240 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:08.806633 24240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "7ec16bc8a5434375b4eab170d53c3913"
format_stamp: "Formatted at 2026-08-10 03:45:08 on dist-test-slave-qg60"
server_key: "2f08c5edbbd1bc17237c4f7b94814678"
server_key_iv: "b0c43a4991a422a1a61a53a38528be25"
server_key_version: "encryptionkey@0"
I20260810 03:45:08.806763 24240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:08.824163 24240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:08.827586 24240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:08.827816 24240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:08.836877 24240 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:35523
I20260810 03:45:08.836896 24322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:35523 every 8 connection(s)
I20260810 03:45:08.837940 24240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:08.841200 24323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:08.846271 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 24240
I20260810 03:45:08.846407 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:08.846690 23067 external_mini_cluster.cc:1428] Setting key 0522efc791fb963d09566551beab6c52
I20260810 03:45:08.847580 24323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913: Bootstrap starting.
I20260810 03:45:08.850147 24323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:08.850946 24323 log.cc:824] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:08.853381 24323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913: No bootstrap required, opened a new log
Aug 10 03:45:08 dist-test-slave-qg60 krb5kdc[24226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:08.858228 24323 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec16bc8a5434375b4eab170d53c3913" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35523 } }
I20260810 03:45:08.858553 24323 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:08.858629 24323 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ec16bc8a5434375b4eab170d53c3913, State: Initialized, Role: FOLLOWER
I20260810 03:45:08.859184 24323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec16bc8a5434375b4eab170d53c3913" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35523 } }
I20260810 03:45:08.859364 24323 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:08.859450 24323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:08.859596 24323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:08.860625 24323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec16bc8a5434375b4eab170d53c3913" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35523 } }
I20260810 03:45:08.861096 24323 leader_election.cc:302] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ec16bc8a5434375b4eab170d53c3913; no voters:
I20260810 03:45:08.861512 24323 leader_election.cc:288] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:08.861939 24331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:08.862169 24331 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [term 1 LEADER]: Becoming Leader. State: Replica: 7ec16bc8a5434375b4eab170d53c3913, State: Running, Role: LEADER
I20260810 03:45:08.862545 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:08.848128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47734 (local address 127.22.134.254:35523)
0810 03:45:08.848565 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:08.848581 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:08.848622 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:45:08.849390 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:08.849417 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:08.849756 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:08.850110 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:08.850938 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:08.852208 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:08.853163 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:08.853724 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:08.853899 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:08.857173 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:08.857180 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:08.857196 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:08.857228 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:08.859204 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:08.859804 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:08.859810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:08.859815 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:08.859932 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:08.860246 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:08.860250 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:08.860252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:08.860671 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:08.860927 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:08.861199 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 03:45:08.861565 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":137,"threads_started":1}
I20260810 03:45:08.862598 24331 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec16bc8a5434375b4eab170d53c3913" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35523 } }
I20260810 03:45:08.863042 24323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:08.865824 24330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ec16bc8a5434375b4eab170d53c3913. Latest consensus state: current_term: 1 leader_uuid: "7ec16bc8a5434375b4eab170d53c3913" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec16bc8a5434375b4eab170d53c3913" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35523 } } }
I20260810 03:45:08.865919 24330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:08.865594 24332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ec16bc8a5434375b4eab170d53c3913" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec16bc8a5434375b4eab170d53c3913" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35523 } } }
I20260810 03:45:08.866170 24332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913 [sys.catalog]: This master's current role is: LEADER
W20260810 03:45:08.868422 24345 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:08.868511 24345 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:08.868615 24346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:08.869535 24346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:08.875208 24346 catalog_manager.cc:1347] Generated new cluster ID: ef4ffbabce674f7c8e57acb16b450928
I20260810 03:45:08.875299 24346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:08.894640 24346 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:08.895735 24346 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:08.904256 24346 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913: Generated new TSK 0
I20260810 03:45:08.905164 24346 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:08.945086 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35523
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:09.063277 24352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:09.063638 24352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:09.063685 24352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:09.067878 24352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:09.067942 24352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:09.067982 24352 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:09.068015 24352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:09.073390 24352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:35523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:09.074405 24352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:09.075361 24352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:09.085636 24358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:09.085659 24357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:09.085832 24352 server_base.cc:1034] running on GCE node
W20260810 03:45:09.085690 24360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:09.086289 24352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:09.086994 24352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:09.088264 24352 hybrid_clock.cc:648] HybridClock initialized: now 1786333509088252 us; error 35 us; skew 500 ppm
Aug 10 03:45:09 dist-test-slave-qg60 krb5kdc[24226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:09.091250 24352 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:09.092161 24352 webserver.cc:460] Webserver started at http://127.22.134.193:41795/ using document root <none> and password file <none>
I20260810 03:45:09.092785 24352 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:09.092891 24352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:09.093142 24352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:09.095232 24352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "e80ec51c2fed4998b42a15d0ec8a1e69"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "6fa3f1e828335bb4177f623f5563001a"
server_key_iv: "11e10ec02b0134e8d1d0bfc754333619"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.095880 24352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "e80ec51c2fed4998b42a15d0ec8a1e69"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "6fa3f1e828335bb4177f623f5563001a"
server_key_iv: "11e10ec02b0134e8d1d0bfc754333619"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.100080 24352 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:45:09.102746 24367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:09.103933 24352 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 03:45:09.104087 24352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "e80ec51c2fed4998b42a15d0ec8a1e69"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "6fa3f1e828335bb4177f623f5563001a"
server_key_iv: "11e10ec02b0134e8d1d0bfc754333619"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.104208 24352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:09.121143 24352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:09.124363 24352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:09.124583 24352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:09.126202 24352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:09.126281 24352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:09.126358 24352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:09.126402 24352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:45:09 dist-test-slave-qg60 krb5kdc[24226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:09.137952 24352 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:34367
I20260810 03:45:09.138001 24494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:34367 every 8 connection(s)
I20260810 03:45:09.139140 24352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:09.141919 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.127362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:50001 (local address 127.22.134.254:35523)
0810 03:45:09.127503 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.127506 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.128612 (+ 1106us) server_negotiation.cc:407] Connection header received
0810 03:45:09.129878 (+ 1266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.129883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.129954 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.130068 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:09.131385 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.132285 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.133939 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.134359 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.134494 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.137949 (+ 3455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:09.137954 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:09.137957 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:09.137994 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:09.139657 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.140272 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.140275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.140277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.140367 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.140718 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.140721 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.140723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.140952 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:09.141065 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.141583 (+ 518us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.141742 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:45:09.142661 24377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.127919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35523 (local address 127.22.134.193:50001)
0810 03:45:09.128423 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.128467 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.129610 (+ 1143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.130259 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.130286 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.130657 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:09.131239 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.131252 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.132435 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.132442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.133789 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.133798 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.134706 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.134711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.134912 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.135633 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:09.135661 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:09.137736 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:09.139803 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.139809 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.139834 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.140152 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.140463 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.140466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.140468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.140611 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.141064 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:09.141071 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:09.141330 (+ 259us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.141518 (+ 188us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.141844 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":142,"threads_started":1}
I20260810 03:45:09.143110 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 24352
I20260810 03:45:09.143230 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:09.143574 23067 external_mini_cluster.cc:1428] Setting key 4589dbc20219719e3d5548157f492a30
I20260810 03:45:09.144778 24495 heartbeater.cc:347] Connected to a master server at 127.22.134.254:35523
I20260810 03:45:09.144941 24495 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:09.145537 24495 heartbeater.cc:511] Master 127.22.134.254:35523 requested a full tablet report, sending...
I20260810 03:45:09.147255 24276 ts_manager.cc:194] Registered new tserver with Master: e80ec51c2fed4998b42a15d0ec8a1e69 (127.22.134.193:34367)
I20260810 03:45:09.148766 24276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:50001
I20260810 03:45:09.155332 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.146444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:49795 (local address 127.22.134.254:35523)
0810 03:45:09.146610 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.146617 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.146825 (+ 208us) server_negotiation.cc:407] Connection header received
0810 03:45:09.146930 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.146935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.146992 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.147081 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:09.147611 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.148388 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.149573 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.149957 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.150062 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.151715 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:09.151719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:09.151722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:09.151746 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:09.153309 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.153822 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.153824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.153825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.153900 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.154409 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.154413 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.154414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.154602 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:09.154699 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.155106 (+ 407us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.155215 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:45:09.155434 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.146384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35523 (local address 127.22.134.193:49795)
0810 03:45:09.146726 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.146742 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.146848 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.147117 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.147120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.147345 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:09.147471 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.147479 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.148548 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.148551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.149429 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.149443 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.150235 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.150241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.150395 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.150965 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:09.150985 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:09.151553 (+ 568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:09.153436 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.153440 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.153442 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.153713 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.153994 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.153999 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.154008 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.154118 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.154726 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:09.154729 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:09.154845 (+ 116us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.154989 (+ 144us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.155170 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":2,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:09.176793 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35523
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:09.290918 24506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:09.291198 24506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:09.291242 24506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:09.295329 24506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:09.295398 24506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:09.295439 24506 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:09.295471 24506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:09.300810 24506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:35523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:09.301863 24506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:09.302886 24506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:09.313519 24511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:09.313687 24506 server_base.cc:1034] running on GCE node
W20260810 03:45:09.313526 24514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:09.313462 24512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:09.314250 24506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:09.314978 24506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:09.316172 24506 hybrid_clock.cc:648] HybridClock initialized: now 1786333509316149 us; error 30 us; skew 500 ppm
Aug 10 03:45:09 dist-test-slave-qg60 krb5kdc[24226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:09.319052 24506 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:09.320046 24506 webserver.cc:460] Webserver started at http://127.22.134.194:39123/ using document root <none> and password file <none>
I20260810 03:45:09.320624 24506 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:09.320726 24506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:09.320981 24506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:09.323031 24506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "ca7f6f710a314dc19ceb77fe8f7141a0"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "ed5ea84ac0646d51b62e969e631230ac"
server_key_iv: "31885ce75c3bb991848491ac2530bb9d"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.323680 24506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "ca7f6f710a314dc19ceb77fe8f7141a0"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "ed5ea84ac0646d51b62e969e631230ac"
server_key_iv: "31885ce75c3bb991848491ac2530bb9d"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.327562 24506 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:45:09.330250 24521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:09.331609 24506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:45:09.331769 24506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "ca7f6f710a314dc19ceb77fe8f7141a0"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "ed5ea84ac0646d51b62e969e631230ac"
server_key_iv: "31885ce75c3bb991848491ac2530bb9d"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.331895 24506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:09.345404 24506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:09.348834 24506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:09.349076 24506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:09.350636 24506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:09.350708 24506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:09.350780 24506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:09.350821 24506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:45:09 dist-test-slave-qg60 krb5kdc[24226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:09.362740 24506 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:36737
I20260810 03:45:09.362886 24652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:36737 every 8 connection(s)
I20260810 03:45:09.363831 24506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:09.364133 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 24506
I20260810 03:45:09.364243 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:09.364559 23067 external_mini_cluster.cc:1428] Setting key c7748260ea4e477b9c04bcb449381a86
I20260810 03:45:09.365988 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.351569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:33697 (local address 127.22.134.254:35523)
0810 03:45:09.351707 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.351711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.352871 (+ 1160us) server_negotiation.cc:407] Connection header received
0810 03:45:09.353972 (+ 1101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.353977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.354054 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.354123 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:09.355861 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.356814 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.358374 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.358624 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.358746 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.361550 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:09.361557 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:09.361562 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:09.361598 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:09.363431 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.364028 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.364032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.364033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.364130 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.364648 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.364652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.364654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.364930 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:09.365033 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.365667 (+ 634us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.365810 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:45:09.366954 24531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.352134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35523 (local address 127.22.134.194:33697)
0810 03:45:09.352650 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.352700 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.353688 (+ 988us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.354585 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.354594 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.354990 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:09.355604 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.355629 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.356960 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.356965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.358226 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.358238 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.358803 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.358807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.359008 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.359629 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:09.359645 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:09.361342 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:09.363570 (+ 2228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.363577 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.363592 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.363857 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.364308 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.364312 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.364313 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.364497 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.365027 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:09.365033 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:09.365353 (+ 320us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.365577 (+ 224us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.365920 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":143,"threads_started":1}
I20260810 03:45:09.369735 24653 heartbeater.cc:347] Connected to a master server at 127.22.134.254:35523
I20260810 03:45:09.369943 24653 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:09.370611 24653 heartbeater.cc:511] Master 127.22.134.254:35523 requested a full tablet report, sending...
I20260810 03:45:09.371924 24276 ts_manager.cc:194] Registered new tserver with Master: ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737)
I20260810 03:45:09.372721 24276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:33697
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:45:09.379848 24661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.372268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35523 (local address 127.22.134.194:57905)
0810 03:45:09.372615 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.372631 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.372767 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.373181 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.373184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.373430 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:09.373540 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.373546 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.374303 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.374306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.374869 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.374876 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.375347 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.375351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.375441 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.376011 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:09.376023 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:09.376363 (+ 340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:09.378167 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.378169 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.378171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.378375 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.378666 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.378669 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.378670 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.378750 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.379310 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:09.379313 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:09.379399 (+ 86us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.379499 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.379632 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":150,"threads_started":1}
I20260810 03:45:09.379917 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.372115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:57905 (local address 127.22.134.254:35523)
0810 03:45:09.372256 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.372260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.372745 (+ 485us) server_negotiation.cc:407] Connection header received
0810 03:45:09.372865 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.372872 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.372937 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.373045 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:09.373658 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.374175 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.374994 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.375232 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.375342 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.376511 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:09.376514 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:09.376517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:09.376542 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:09.378041 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.378483 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.378486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.378487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.378577 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.378833 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.378836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.378837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.379056 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:09.379346 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.379581 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.379684 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:09.396405 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35523
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:09.516361 24663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:09.516638 24663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:09.516714 24663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:09.520771 24663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:09.520839 24663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:09.520900 24663 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:09.520973 24663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:09.526567 24663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:35523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:09.527715 24663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:09.528813 24663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:09.539397 24670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:09.539408 24672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:09.539649 24663 server_base.cc:1034] running on GCE node
W20260810 03:45:09.539425 24669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:09.540187 24663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:09.540932 24663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:09.542127 24663 hybrid_clock.cc:648] HybridClock initialized: now 1786333509542110 us; error 29 us; skew 500 ppm
Aug 10 03:45:09 dist-test-slave-qg60 krb5kdc[24226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:09.545179 24663 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:09.546228 24663 webserver.cc:460] Webserver started at http://127.22.134.195:39599/ using document root <none> and password file <none>
I20260810 03:45:09.546834 24663 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:09.546897 24663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:09.547120 24663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:09.549288 24663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "da54425b060f4dcb94f0d2f60af03f14"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "6a8ba33d7f2edb60b7393c5678537873"
server_key_iv: "0afa25a0a3c501f6535115edba733848"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.549880 24663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "da54425b060f4dcb94f0d2f60af03f14"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "6a8ba33d7f2edb60b7393c5678537873"
server_key_iv: "0afa25a0a3c501f6535115edba733848"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.553812 24663 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:45:09.556447 24679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:09.557848 24663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:45:09.557967 24663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "da54425b060f4dcb94f0d2f60af03f14"
format_stamp: "Formatted at 2026-08-10 03:45:09 on dist-test-slave-qg60"
server_key: "6a8ba33d7f2edb60b7393c5678537873"
server_key_iv: "0afa25a0a3c501f6535115edba733848"
server_key_version: "encryptionkey@0"
I20260810 03:45:09.558101 24663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:09.572211 24663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:09.575711 24663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:09.575943 24663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:09.577591 24663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:09.577667 24663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:09.577742 24663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:09.577783 24663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:45:09 dist-test-slave-qg60 krb5kdc[24226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:09.589046 24663 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:39027
I20260810 03:45:09.589201 24805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:39027 every 8 connection(s)
I20260810 03:45:09.590287 24663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:09.592340 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.578484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:59975 (local address 127.22.134.254:35523)
0810 03:45:09.578637 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.578641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.579695 (+ 1054us) server_negotiation.cc:407] Connection header received
0810 03:45:09.580899 (+ 1204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.580904 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.580965 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.581029 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:09.582399 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.583154 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.584627 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.584918 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.585041 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.588170 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:09.588173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:09.588175 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:09.588200 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:09.590048 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.590669 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.590673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.590675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.590784 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.591190 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.591194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.591195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.591404 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:09.591520 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.592022 (+ 502us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.592166 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:45:09.593201 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.579013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35523 (local address 127.22.134.195:59975)
0810 03:45:09.579540 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.579584 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.580590 (+ 1006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.581415 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.581421 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.581768 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:09.582244 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.582257 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.583285 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.583288 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.584472 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.584483 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.585098 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.585102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.585268 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.585994 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:09.586030 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:09.587985 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:09.590205 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.590211 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.590223 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.590547 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.590905 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.590908 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.590910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.591094 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.591518 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:09.591526 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:09.591781 (+ 255us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.591979 (+ 198us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.592310 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":144,"threads_started":1}
I20260810 03:45:09.594177 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 24663
I20260810 03:45:09.594305 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:09.594594 23067 external_mini_cluster.cc:1428] Setting key 40a189175504f14a9d13167c52795259
I20260810 03:45:09.594776 24806 heartbeater.cc:347] Connected to a master server at 127.22.134.254:35523
I20260810 03:45:09.595186 24806 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:09.596804 24806 heartbeater.cc:511] Master 127.22.134.254:35523 requested a full tablet report, sending...
I20260810 03:45:09.597944 24276 ts_manager.cc:194] Registered new tserver with Master: da54425b060f4dcb94f0d2f60af03f14 (127.22.134.195:39027)
I20260810 03:45:09.598592 24276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:59975
I20260810 03:45:09.605682 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.597691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:55717 (local address 127.22.134.254:35523)
0810 03:45:09.597812 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.597816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.597832 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:45:09.597917 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.597920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.597962 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.598054 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:09.598626 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.599391 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.600304 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.600573 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.600690 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.602497 (+ 1807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:09.602500 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:09.602502 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:09.602524 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:09.603900 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.604389 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.604393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.604394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.604486 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.604876 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.604878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.604880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.605060 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:09.605152 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.605445 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.605552 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 03:45:09.605719 24812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.597417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35523 (local address 127.22.134.195:55717)
0810 03:45:09.597718 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.597735 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.597825 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.598174 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.598176 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.598359 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:09.598481 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.598486 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.599550 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.599553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.600181 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.600190 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.600695 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.600698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.600828 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.601514 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:09.601529 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:09.602370 (+ 841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:09.604024 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.604028 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.604031 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.604266 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.604633 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:09.604635 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:09.604637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:09.604772 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:09.605191 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:09.605194 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:09.605285 (+ 91us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.605390 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.605550 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":36,"thread_start_us":144,"threads_started":1}
I20260810 03:45:09.609123 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 03:45:09 dist-test-slave-qg60 krb5kdc[24226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:45:09 dist-test-slave-qg60 krb5kdc[24226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:09.639961 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.630413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47736 (local address 127.22.134.254:35523)
0810 03:45:09.630580 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.630584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.630600 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:45:09.630647 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.630649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.630693 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.630816 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:09.631698 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.632293 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.633328 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.633607 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.633730 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.636603 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:09.636607 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:09.636609 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:09.636638 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:09.638090 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.638566 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.638570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.638572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.638663 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:09.638973 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:09.638977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:09.638979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:09.639198 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:09.639356 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.639640 (+ 284us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.639775 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:45:09.643175 24276 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:09.646548 24276 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:09.662420 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.656617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40246 (local address 127.22.134.193:34367)
0810 03:45:09.656933 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.656943 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.657355 (+ 412us) server_negotiation.cc:407] Connection header received
0810 03:45:09.657433 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.657438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.657622 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.657775 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:09.658049 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.659152 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.660682 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.661513 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.661669 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.661817 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.662149 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.662262 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":118,"threads_started":1}
I20260810 03:45:09.662420 24824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.656516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:39027 (local address 127.0.0.1:51644)
0810 03:45:09.657645 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.657657 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.657756 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.658438 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.658441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.658459 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:09.658547 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.658554 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.659909 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.659913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.660977 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.660985 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.661904 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.661907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.662109 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.662135 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.662214 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.662282 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1063,"mutex_wait_us":73,"thread_start_us":114,"threads_started":1}
I20260810 03:45:09.662536 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.657118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51644 (local address 127.22.134.195:39027)
0810 03:45:09.658028 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.658040 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.658059 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:45:09.658132 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.658135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.658258 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.658702 (+ 444us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:09.658809 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.659771 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.661091 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.661802 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.661949 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.662077 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.662256 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.662361 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":799,"thread_start_us":121,"threads_started":1}
I20260810 03:45:09.663347 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.655725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:36737 (local address 127.0.0.1:60128)
0810 03:45:09.656493 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.656547 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.656704 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.657507 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.657513 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.657536 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:09.657672 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.657683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.659170 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.659174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.660637 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.660648 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.661890 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.661894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.663002 (+ 1108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.663041 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.663138 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.663214 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":92,"thread_start_us":98,"threads_started":1}
I20260810 03:45:09.663511 24825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.655944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60128 (local address 127.22.134.194:36737)
0810 03:45:09.656428 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.656444 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.656668 (+ 224us) server_negotiation.cc:407] Connection header received
0810 03:45:09.656950 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.656956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.657188 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.657343 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:09.657808 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.659044 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.660803 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.661560 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.661685 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.661816 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.663173 (+ 1357us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.663311 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":182,"threads_started":1}
I20260810 03:45:09.662442 24826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.655943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:34367 (local address 127.0.0.1:40246)
0810 03:45:09.657150 (+ 1207us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.657165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.657261 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.657765 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.657768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.657785 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:09.657917 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.657923 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.659272 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.659277 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.660547 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.660557 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.661683 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.661687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.661812 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.661874 (+ 62us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.662005 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.662209 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1146,"mutex_wait_us":49,"thread_start_us":99,"threads_started":1}
I20260810 03:45:09.665905 24731 tablet_service.cc:1467] Processing CreateTablet for tablet b15d0493a18a46a4b341bf3ab3932206 (DEFAULT_TABLE table=test-table [id=e1b0f83469534764a060655fc0feb50f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:09.666280 24577 tablet_service.cc:1467] Processing CreateTablet for tablet b15d0493a18a46a4b341bf3ab3932206 (DEFAULT_TABLE table=test-table [id=e1b0f83469534764a060655fc0feb50f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:09.667021 24731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b15d0493a18a46a4b341bf3ab3932206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:09.667263 24577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b15d0493a18a46a4b341bf3ab3932206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:09.674295 24830 tablet_bootstrap.cc:492] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Bootstrap starting.
I20260810 03:45:09.674513 24423 tablet_service.cc:1467] Processing CreateTablet for tablet b15d0493a18a46a4b341bf3ab3932206 (DEFAULT_TABLE table=test-table [id=e1b0f83469534764a060655fc0feb50f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:09.675674 24423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b15d0493a18a46a4b341bf3ab3932206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:09.675803 24831 tablet_bootstrap.cc:492] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: Bootstrap starting.
I20260810 03:45:09.676587 24830 tablet_bootstrap.cc:654] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:09.677367 24830 log.cc:824] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:09.677947 24831 tablet_bootstrap.cc:654] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:09.678787 24831 log.cc:824] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:09.679862 24830 tablet_bootstrap.cc:492] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: No bootstrap required, opened a new log
I20260810 03:45:09.680073 24830 ts_tablet_manager.cc:1397] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:45:09.680826 24831 tablet_bootstrap.cc:492] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: No bootstrap required, opened a new log
I20260810 03:45:09.681012 24831 ts_tablet_manager.cc:1397] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260810 03:45:09.683226 24835 tablet_bootstrap.cc:492] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: Bootstrap starting.
I20260810 03:45:09.683981 24830 raft_consensus.cc:348] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.684371 24830 raft_consensus.cc:374] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:09.684443 24830 raft_consensus.cc:729] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da54425b060f4dcb94f0d2f60af03f14, State: Initialized, Role: FOLLOWER
I20260810 03:45:09.684902 24830 consensus_queue.cc:260] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.685829 24835 tablet_bootstrap.cc:654] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:09.685847 24831 raft_consensus.cc:348] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.686122 24831 raft_consensus.cc:374] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:09.686193 24831 raft_consensus.cc:729] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca7f6f710a314dc19ceb77fe8f7141a0, State: Initialized, Role: FOLLOWER
I20260810 03:45:09.686354 24830 ts_tablet_manager.cc:1428] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 03:45:09.686643 24831 consensus_queue.cc:260] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.686733 24806 heartbeater.cc:503] Master 127.22.134.254:35523 was elected leader, sending a full tablet report...
I20260810 03:45:09.686925 24835 log.cc:824] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:09.687409 24653 heartbeater.cc:503] Master 127.22.134.254:35523 was elected leader, sending a full tablet report...
I20260810 03:45:09.687608 24831 ts_tablet_manager.cc:1428] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:45:09.689632 24835 tablet_bootstrap.cc:492] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: No bootstrap required, opened a new log
I20260810 03:45:09.690026 24835 ts_tablet_manager.cc:1397] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:45:09.695170 24835 raft_consensus.cc:348] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.695482 24835 raft_consensus.cc:374] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:09.695547 24835 raft_consensus.cc:729] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80ec51c2fed4998b42a15d0ec8a1e69, State: Initialized, Role: FOLLOWER
I20260810 03:45:09.696010 24835 consensus_queue.cc:260] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.696677 24495 heartbeater.cc:503] Master 127.22.134.254:35523 was elected leader, sending a full tablet report...
I20260810 03:45:09.696920 24835 ts_tablet_manager.cc:1428] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 03:45:09.775537 24839 raft_consensus.cc:482] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:09.775784 24839 raft_consensus.cc:504] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.777276 24839 leader_election.cc:288] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737), da54425b060f4dcb94f0d2f60af03f14 (127.22.134.195:39027)
I20260810 03:45:09.782208 24841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.778006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:39027 (local address 127.22.134.193:56933)
0810 03:45:09.778377 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.778393 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.778471 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.778748 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.778750 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.778766 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:09.778866 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.778870 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.779689 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.779695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.780825 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.780836 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.781586 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.781590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.781760 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.781802 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.781877 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.781964 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":29,"thread_start_us":121,"threads_started":1}
I20260810 03:45:09.782226 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.778311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:56933 (local address 127.22.134.195:39027)
0810 03:45:09.778454 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.778458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.778472 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:45:09.778581 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.778584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.778634 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.778720 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:09.778986 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.779560 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.780958 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.781440 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.781540 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.781582 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.781913 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.782020 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:45:09.782483 24825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.777689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:45649 (local address 127.22.134.194:36737)
0810 03:45:09.777873 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.777878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.778141 (+ 263us) server_negotiation.cc:407] Connection header received
0810 03:45:09.778422 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.778429 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.778486 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.778566 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:09.779081 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.779651 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.781152 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.781720 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.781850 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.781904 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.782231 (+ 327us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.782317 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 03:45:09.782493 24840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.777561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:36737 (local address 127.22.134.193:45649)
0810 03:45:09.777982 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.777998 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.778225 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.778629 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.778633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.778654 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:09.778867 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.778876 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.779776 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.779779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.781004 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.781015 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.781870 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.781876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.782063 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.782087 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.782173 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.782241 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":83,"thread_start_us":148,"threads_started":1}
I20260810 03:45:09.783090 24599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15d0493a18a46a4b341bf3ab3932206" candidate_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" is_pre_election: true
I20260810 03:45:09.783089 24754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15d0493a18a46a4b341bf3ab3932206" candidate_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da54425b060f4dcb94f0d2f60af03f14" is_pre_election: true
I20260810 03:45:09.783397 24599 raft_consensus.cc:2454] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80ec51c2fed4998b42a15d0ec8a1e69 in term 0.
I20260810 03:45:09.783409 24754 raft_consensus.cc:2454] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80ec51c2fed4998b42a15d0ec8a1e69 in term 0.
I20260810 03:45:09.783967 24371 leader_election.cc:302] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da54425b060f4dcb94f0d2f60af03f14, e80ec51c2fed4998b42a15d0ec8a1e69; no voters:
I20260810 03:45:09.784255 24839 raft_consensus.cc:2781] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:09.784397 24839 raft_consensus.cc:482] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:09.784471 24839 raft_consensus.cc:3037] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:09.785997 24839 raft_consensus.cc:504] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.786373 24839 leader_election.cc:288] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [CANDIDATE]: Term 1 election: Requested vote from peers ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737), da54425b060f4dcb94f0d2f60af03f14 (127.22.134.195:39027)
I20260810 03:45:09.786998 24754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15d0493a18a46a4b341bf3ab3932206" candidate_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da54425b060f4dcb94f0d2f60af03f14"
I20260810 03:45:09.786999 24599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b15d0493a18a46a4b341bf3ab3932206" candidate_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0"
I20260810 03:45:09.787122 24754 raft_consensus.cc:3037] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:09.787146 24599 raft_consensus.cc:3037] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:09.788336 24754 raft_consensus.cc:2454] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80ec51c2fed4998b42a15d0ec8a1e69 in term 1.
I20260810 03:45:09.788653 24371 leader_election.cc:302] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da54425b060f4dcb94f0d2f60af03f14, e80ec51c2fed4998b42a15d0ec8a1e69; no voters:
I20260810 03:45:09.788882 24839 raft_consensus.cc:2781] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:09.789067 24599 raft_consensus.cc:2454] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80ec51c2fed4998b42a15d0ec8a1e69 in term 1.
I20260810 03:45:09.789242 24839 raft_consensus.cc:686] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 LEADER]: Becoming Leader. State: Replica: e80ec51c2fed4998b42a15d0ec8a1e69, State: Running, Role: LEADER
I20260810 03:45:09.789609 24839 consensus_queue.cc:237] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.792956 24276 catalog_manager.cc:5495] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 reported cstate change: term changed from 0 to 1, leader changed from <none> to e80ec51c2fed4998b42a15d0ec8a1e69 (127.22.134.193). New cstate: current_term: 1 leader_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } health_report { overall_health: UNKNOWN } } }
I20260810 03:45:09.823716 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.819530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40258 (local address 127.22.134.193:34367)
0810 03:45:09.819655 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.819659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.819681 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:45:09.819884 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.819886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.819940 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.820031 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:09.820538 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.821249 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.822224 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.822430 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.822514 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.822862 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:09.823309 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:09.823399 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.823548 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.823602 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:45:09.830675 24754 raft_consensus.cc:1261] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Refusing update from remote peer e80ec51c2fed4998b42a15d0ec8a1e69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:09.831547 24599 raft_consensus.cc:1261] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Refusing update from remote peer e80ec51c2fed4998b42a15d0ec8a1e69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:09.831518 24839 consensus_queue.cc:1035] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:09.832254 24839 consensus_queue.cc:1035] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:09.838814 24845 mvcc.cc:205] Tried to move back new op lower bound from 7316822056255721472 to 7316822056101154816. Current Snapshot: MvccSnapshot[applied={T|T < 7316822056255721472}]
W20260810 03:45:09.841384 24807 tablet.cc:2369] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:09.844929 24846 mvcc.cc:205] Tried to move back new op lower bound from 7316822056255721472 to 7316822056101154816. Current Snapshot: MvccSnapshot[applied={T|T < 7316822056255721472 or (T in {7316822056255721472})}]
I20260810 03:45:09.856639 24276 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:09.856941 24276 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:09.859925 24276 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913: Sending DeleteTablet for 3 replicas of tablet b15d0493a18a46a4b341bf3ab3932206
I20260810 03:45:09.861135 24577 tablet_service.cc:1514] Processing DeleteTablet for tablet b15d0493a18a46a4b341bf3ab3932206 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:09 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:60128
I20260810 03:45:09.861249 24423 tablet_service.cc:1514] Processing DeleteTablet for tablet b15d0493a18a46a4b341bf3ab3932206 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:09 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:40246
I20260810 03:45:09.861291 24731 tablet_service.cc:1514] Processing DeleteTablet for tablet b15d0493a18a46a4b341bf3ab3932206 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:09 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:51644
I20260810 03:45:09.861984 24856 tablet_replica.cc:330] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: stopping tablet replica
I20260810 03:45:09.862197 24854 tablet_replica.cc:330] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: stopping tablet replica
I20260810 03:45:09.862277 24276 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 03:45:09.862372 24856 raft_consensus.cc:2229] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 LEADER]: Raft consensus shutting down.
W20260810 03:45:09.862721 24276 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:09.862906 24854 raft_consensus.cc:2229] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:09.862921 24856 raft_consensus.cc:2258] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:09.863744 24855 tablet_replica.cc:330] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: stopping tablet replica
I20260810 03:45:09.864030 24855 raft_consensus.cc:2229] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:09.863485 24854 raft_consensus.cc:2258] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:09.864357 24855 raft_consensus.cc:2258] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:09.865762 24856 ts_tablet_manager.cc:1905] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:09.868700 24423 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc587e4a1964ff9acce72894de90349 (DEFAULT_TABLE table=test-table [id=63e2c1209dc7479b95db766490f27ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:09.869127 24423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc587e4a1964ff9acce72894de90349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:09.869194 24856 ts_tablet_manager.cc:1918] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:09.869279 24856 log.cc:1196] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/b15d0493a18a46a4b341bf3ab3932206
I20260810 03:45:09.869315 24577 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc587e4a1964ff9acce72894de90349 (DEFAULT_TABLE table=test-table [id=63e2c1209dc7479b95db766490f27ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:09.869632 24856 ts_tablet_manager.cc:1939] T b15d0493a18a46a4b341bf3ab3932206 P e80ec51c2fed4998b42a15d0ec8a1e69: Deleting consensus metadata
I20260810 03:45:09.869655 24577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc587e4a1964ff9acce72894de90349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:09.871968 24855 ts_tablet_manager.cc:1905] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:09.872220 24258 catalog_manager.cc:4841] TS e80ec51c2fed4998b42a15d0ec8a1e69 (127.22.134.193:34367): tablet b15d0493a18a46a4b341bf3ab3932206 (table test-table [id=e1b0f83469534764a060655fc0feb50f]) successfully deleted
I20260810 03:45:09.872747 24831 tablet_bootstrap.cc:492] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: Bootstrap starting.
I20260810 03:45:09.873085 24731 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc587e4a1964ff9acce72894de90349 (DEFAULT_TABLE table=test-table [id=63e2c1209dc7479b95db766490f27ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:09.873430 24731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc587e4a1964ff9acce72894de90349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:09.873565 24835 tablet_bootstrap.cc:492] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: Bootstrap starting.
I20260810 03:45:09.873971 24831 tablet_bootstrap.cc:654] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:09.875105 24835 tablet_bootstrap.cc:654] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:09.875151 24855 ts_tablet_manager.cc:1918] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:09.875248 24855 log.cc:1196] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/b15d0493a18a46a4b341bf3ab3932206
I20260810 03:45:09.875741 24855 ts_tablet_manager.cc:1939] T b15d0493a18a46a4b341bf3ab3932206 P ca7f6f710a314dc19ceb77fe8f7141a0: Deleting consensus metadata
I20260810 03:45:09.876679 24830 tablet_bootstrap.cc:492] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: Bootstrap starting.
I20260810 03:45:09.877496 24260 catalog_manager.cc:4841] TS ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737): tablet b15d0493a18a46a4b341bf3ab3932206 (table test-table [id=e1b0f83469534764a060655fc0feb50f]) successfully deleted
I20260810 03:45:09.877833 24854 ts_tablet_manager.cc:1905] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:09.878197 24830 tablet_bootstrap.cc:654] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:09.879138 24831 tablet_bootstrap.cc:492] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: No bootstrap required, opened a new log
I20260810 03:45:09.879145 24835 tablet_bootstrap.cc:492] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: No bootstrap required, opened a new log
I20260810 03:45:09.879242 24835 ts_tablet_manager.cc:1397] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260810 03:45:09.879243 24831 ts_tablet_manager.cc:1397] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 03:45:09.879577 24830 tablet_bootstrap.cc:492] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: No bootstrap required, opened a new log
I20260810 03:45:09.879690 24830 ts_tablet_manager.cc:1397] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:09.879900 24831 raft_consensus.cc:348] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.880049 24831 raft_consensus.cc:374] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:09.880097 24831 raft_consensus.cc:729] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca7f6f710a314dc19ceb77fe8f7141a0, State: Initialized, Role: FOLLOWER
I20260810 03:45:09.880236 24831 consensus_queue.cc:260] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.880288 24830 raft_consensus.cc:348] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.880409 24830 raft_consensus.cc:374] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:09.880345 24835 raft_consensus.cc:348] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.880440 24830 raft_consensus.cc:729] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da54425b060f4dcb94f0d2f60af03f14, State: Initialized, Role: FOLLOWER
I20260810 03:45:09.880450 24835 raft_consensus.cc:374] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:09.880486 24835 raft_consensus.cc:729] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80ec51c2fed4998b42a15d0ec8a1e69, State: Initialized, Role: FOLLOWER
I20260810 03:45:09.880512 24831 ts_tablet_manager.cc:1428] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 03:45:09.880571 24830 consensus_queue.cc:260] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.880611 24835 consensus_queue.cc:260] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.880868 24830 ts_tablet_manager.cc:1428] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260810 03:45:09.880957 24835 ts_tablet_manager.cc:1428] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 03:45:09.882308 24854 ts_tablet_manager.cc:1918] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:09.882462 24854 log.cc:1196] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/b15d0493a18a46a4b341bf3ab3932206
I20260810 03:45:09.882877 24854 ts_tablet_manager.cc:1939] T b15d0493a18a46a4b341bf3ab3932206 P da54425b060f4dcb94f0d2f60af03f14: Deleting consensus metadata
I20260810 03:45:09.884544 24260 catalog_manager.cc:4841] TS da54425b060f4dcb94f0d2f60af03f14 (127.22.134.195:39027): tablet b15d0493a18a46a4b341bf3ab3932206 (table test-table [id=e1b0f83469534764a060655fc0feb50f]) successfully deleted
W20260810 03:45:09.890650 24496 tablet.cc:2369] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:09.946811 24836 raft_consensus.cc:482] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:09.947000 24836 raft_consensus.cc:504] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.948235 24836 leader_election.cc:288] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80ec51c2fed4998b42a15d0ec8a1e69 (127.22.134.193:34367), ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737)
I20260810 03:45:09.953003 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.949005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35401 (local address 127.22.134.193:34367)
0810 03:45:09.949164 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.949171 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.949186 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:45:09.949239 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.949242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.949285 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.949363 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:09.949711 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.950472 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.951746 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.952358 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.952488 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.952546 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.952789 (+ 243us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.952865 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 03:45:09.953018 24860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.948498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:34367 (local address 127.22.134.195:35401)
0810 03:45:09.948980 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.948993 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.949103 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.949405 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.949408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.949430 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:09.949576 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.949584 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.950589 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.950594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.951613 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.951622 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.952500 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.952504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.952610 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.952639 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.952767 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.952849 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":112,"thread_start_us":72,"threads_started":1}
I20260810 03:45:09.953230 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.948488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:36737 (local address 127.22.134.195:33443)
0810 03:45:09.948660 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:09.948678 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:09.948797 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:09.949214 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:09.949217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:09.949231 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:09.949363 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.949370 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.950424 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.950427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.951771 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:09.951782 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.952789 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.952792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:09.952905 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.952927 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:45:09.952999 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 03:45:09.953079 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":28}
I20260810 03:45:09.953739 24825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:09.948715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:33443 (local address 127.22.134.194:36737)
0810 03:45:09.948881 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:09.948886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:09.948903 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:45:09.948977 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:09.948981 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:09.949029 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:09.949123 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:09.949504 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.950293 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.951913 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:09.952528 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:09.952641 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:09.952676 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:09.953534 (+ 858us) server_negotiation.cc:299] Negotiation successful
0810 03:45:09.953637 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:45:09.954035 24431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc587e4a1964ff9acce72894de90349" candidate_uuid: "da54425b060f4dcb94f0d2f60af03f14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" is_pre_election: true
I20260810 03:45:09.954207 24599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc587e4a1964ff9acce72894de90349" candidate_uuid: "da54425b060f4dcb94f0d2f60af03f14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" is_pre_election: true
I20260810 03:45:09.954352 24599 raft_consensus.cc:2454] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da54425b060f4dcb94f0d2f60af03f14 in term 0.
I20260810 03:45:09.954325 24431 raft_consensus.cc:2454] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da54425b060f4dcb94f0d2f60af03f14 in term 0.
I20260810 03:45:09.954841 24682 leader_election.cc:302] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca7f6f710a314dc19ceb77fe8f7141a0, da54425b060f4dcb94f0d2f60af03f14; no voters:
I20260810 03:45:09.955304 24836 raft_consensus.cc:2781] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:09.955385 24836 raft_consensus.cc:482] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:09.955446 24836 raft_consensus.cc:3037] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:09.956667 24836 raft_consensus.cc:504] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.957108 24836 leader_election.cc:288] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [CANDIDATE]: Term 1 election: Requested vote from peers e80ec51c2fed4998b42a15d0ec8a1e69 (127.22.134.193:34367), ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737)
I20260810 03:45:09.957477 24599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc587e4a1964ff9acce72894de90349" candidate_uuid: "da54425b060f4dcb94f0d2f60af03f14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0"
I20260810 03:45:09.957461 24431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc587e4a1964ff9acce72894de90349" candidate_uuid: "da54425b060f4dcb94f0d2f60af03f14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69"
I20260810 03:45:09.957615 24431 raft_consensus.cc:3037] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:09.957624 24599 raft_consensus.cc:3037] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:09.958570 24599 raft_consensus.cc:2454] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da54425b060f4dcb94f0d2f60af03f14 in term 1.
I20260810 03:45:09.958873 24682 leader_election.cc:302] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca7f6f710a314dc19ceb77fe8f7141a0, da54425b060f4dcb94f0d2f60af03f14; no voters:
I20260810 03:45:09.959013 24431 raft_consensus.cc:2454] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da54425b060f4dcb94f0d2f60af03f14 in term 1.
I20260810 03:45:09.959089 24836 raft_consensus.cc:2781] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:09.959438 24836 raft_consensus.cc:686] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 1 LEADER]: Becoming Leader. State: Replica: da54425b060f4dcb94f0d2f60af03f14, State: Running, Role: LEADER
I20260810 03:45:09.959724 24836 consensus_queue.cc:237] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:09.962567 24275 catalog_manager.cc:5495] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 reported cstate change: term changed from 0 to 1, leader changed from <none> to da54425b060f4dcb94f0d2f60af03f14 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } health_report { overall_health: HEALTHY } } }
Aug 10 03:45:10 dist-test-slave-qg60 krb5kdc[24226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333508, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:10.013732 24328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.002966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47750 (local address 127.22.134.254:35523)
0810 03:45:10.003151 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:10.003156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:10.003608 (+ 452us) server_negotiation.cc:407] Connection header received
0810 03:45:10.003662 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:10.003664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:10.003709 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:10.003791 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:10.004906 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.005520 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.006666 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.006891 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.006987 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.010155 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:10.010158 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:10.010161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:10.010193 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:10.011864 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:10.012368 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:10.012373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:10.012375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:10.012453 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:10.012779 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:10.012782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:10.012783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:10.012976 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:10.013100 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:10.013409 (+ 309us) server_negotiation.cc:299] Negotiation successful
0810 03:45:10.013579 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":69}
I20260810 03:45:10.013733 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.002850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35523 (local address 127.0.0.1:47750)
0810 03:45:10.003415 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:10.003435 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:10.003579 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:10.003855 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:10.003858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:10.004589 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:10.004718 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:10.004727 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.005653 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.005657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:10.006522 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:10.006534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.007033 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.007037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:10.007142 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.007833 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:10.007849 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:10.009982 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:10.011985 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:10.011998 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:10.012005 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:10.012262 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:10.012547 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:10.012552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:10.012554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:10.012645 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:10.013096 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:10.013105 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:10.013229 (+ 124us) client_negotiation.cc:769] Sending connection context
0810 03:45:10.013348 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 03:45:10.013520 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":236,"threads_started":1}
I20260810 03:45:10.019232 24275 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:47750:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 03:45:10.020043 24275 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:10.025739 24423 tablet_service.cc:1467] Processing CreateTablet for tablet 464bd30776924f149cd4ea0100859332 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=514160037154479fad946390e442130b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:10.025934 24577 tablet_service.cc:1467] Processing CreateTablet for tablet 464bd30776924f149cd4ea0100859332 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=514160037154479fad946390e442130b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:10.026043 24731 tablet_service.cc:1467] Processing CreateTablet for tablet 464bd30776924f149cd4ea0100859332 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=514160037154479fad946390e442130b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:10.026285 24423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 464bd30776924f149cd4ea0100859332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:10.026312 24577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 464bd30776924f149cd4ea0100859332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:10.026407 24731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 464bd30776924f149cd4ea0100859332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:10.029587 24835 tablet_bootstrap.cc:492] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: Bootstrap starting.
I20260810 03:45:10.029896 24831 tablet_bootstrap.cc:492] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: Bootstrap starting.
I20260810 03:45:10.031046 24831 tablet_bootstrap.cc:654] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:10.031065 24835 tablet_bootstrap.cc:654] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:10.032785 24835 tablet_bootstrap.cc:492] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: No bootstrap required, opened a new log
I20260810 03:45:10.032878 24835 ts_tablet_manager.cc:1397] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.002s
I20260810 03:45:10.033100 24831 tablet_bootstrap.cc:492] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: No bootstrap required, opened a new log
I20260810 03:45:10.033195 24831 ts_tablet_manager.cc:1397] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:10.033535 24835 raft_consensus.cc:348] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.033671 24835 raft_consensus.cc:374] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:10.033713 24835 raft_consensus.cc:729] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80ec51c2fed4998b42a15d0ec8a1e69, State: Initialized, Role: FOLLOWER
I20260810 03:45:10.033850 24835 consensus_queue.cc:260] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.033818 24831 raft_consensus.cc:348] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.033952 24831 raft_consensus.cc:374] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:10.034022 24831 raft_consensus.cc:729] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca7f6f710a314dc19ceb77fe8f7141a0, State: Initialized, Role: FOLLOWER
I20260810 03:45:10.034207 24830 tablet_bootstrap.cc:492] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: Bootstrap starting.
I20260810 03:45:10.034341 24831 consensus_queue.cc:260] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.034700 24837 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.034889 24837 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:10.035367 24830 tablet_bootstrap.cc:654] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:10.037168 24842 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.037353 24842 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:10.037348 24831 ts_tablet_manager.cc:1428] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260810 03:45:10.038147 24835 ts_tablet_manager.cc:1428] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260810 03:45:10.039290 24830 tablet_bootstrap.cc:492] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: No bootstrap required, opened a new log
I20260810 03:45:10.039415 24830 ts_tablet_manager.cc:1397] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 03:45:10.040050 24830 raft_consensus.cc:348] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.040225 24830 raft_consensus.cc:374] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:10.040272 24830 raft_consensus.cc:729] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da54425b060f4dcb94f0d2f60af03f14, State: Initialized, Role: FOLLOWER
I20260810 03:45:10.040444 24830 consensus_queue.cc:260] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.040714 24836 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.040931 24836 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:10.040890 24830 ts_tablet_manager.cc:1428] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
W20260810 03:45:10.115403 24654 tablet.cc:2369] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:10.381500 24836 consensus_queue.cc:1035] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:10.382615 24836 raft_consensus.cc:482] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:10.382730 24836 raft_consensus.cc:504] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.383157 24836 leader_election.cc:288] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80ec51c2fed4998b42a15d0ec8a1e69 (127.22.134.193:34367), ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737)
I20260810 03:45:10.383672 24599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "464bd30776924f149cd4ea0100859332" candidate_uuid: "da54425b060f4dcb94f0d2f60af03f14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" is_pre_election: true
I20260810 03:45:10.383780 24444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "464bd30776924f149cd4ea0100859332" candidate_uuid: "da54425b060f4dcb94f0d2f60af03f14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" is_pre_election: true
I20260810 03:45:10.383837 24599 raft_consensus.cc:2454] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da54425b060f4dcb94f0d2f60af03f14 in term 0.
I20260810 03:45:10.383914 24444 raft_consensus.cc:2454] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da54425b060f4dcb94f0d2f60af03f14 in term 0.
I20260810 03:45:10.384280 24682 leader_election.cc:302] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca7f6f710a314dc19ceb77fe8f7141a0, da54425b060f4dcb94f0d2f60af03f14; no voters:
I20260810 03:45:10.384668 24836 raft_consensus.cc:2781] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:10.384765 24836 raft_consensus.cc:482] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:10.384812 24836 raft_consensus.cc:3037] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:10.386132 24836 raft_consensus.cc:504] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.386497 24836 leader_election.cc:288] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [CANDIDATE]: Term 1 election: Requested vote from peers e80ec51c2fed4998b42a15d0ec8a1e69 (127.22.134.193:34367), ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737)
I20260810 03:45:10.386590 24836 consensus_queue.cc:1035] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:10.386896 24599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "464bd30776924f149cd4ea0100859332" candidate_uuid: "da54425b060f4dcb94f0d2f60af03f14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0"
I20260810 03:45:10.387028 24599 raft_consensus.cc:3037] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:10.388298 24599 raft_consensus.cc:2454] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da54425b060f4dcb94f0d2f60af03f14 in term 1.
I20260810 03:45:10.388773 24431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "464bd30776924f149cd4ea0100859332" candidate_uuid: "da54425b060f4dcb94f0d2f60af03f14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69"
I20260810 03:45:10.388906 24431 raft_consensus.cc:3037] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:10.389330 24682 leader_election.cc:302] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca7f6f710a314dc19ceb77fe8f7141a0, da54425b060f4dcb94f0d2f60af03f14; no voters:
I20260810 03:45:10.389570 24873 raft_consensus.cc:2781] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:10.389670 24873 raft_consensus.cc:686] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [term 1 LEADER]: Becoming Leader. State: Replica: da54425b060f4dcb94f0d2f60af03f14, State: Running, Role: LEADER
I20260810 03:45:10.389794 24873 consensus_queue.cc:237] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } }
I20260810 03:45:10.390183 24431 raft_consensus.cc:2454] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da54425b060f4dcb94f0d2f60af03f14 in term 1.
I20260810 03:45:10.390480 24836 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: TxnStatusTablet state changed. Reason: New leader da54425b060f4dcb94f0d2f60af03f14. Latest consensus state: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.390591 24836 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:10.391039 24881 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 03:45:10.391258 24881 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 03:45:10.391530 24274 catalog_manager.cc:5495] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 reported cstate change: term changed from 0 to 1, leader changed from <none> to da54425b060f4dcb94f0d2f60af03f14 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } health_report { overall_health: HEALTHY } } }
I20260810 03:45:10.414006 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.408107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:39027 (local address 127.0.0.1:51658)
0810 03:45:10.408361 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:10.408397 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:10.408505 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:10.409083 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:10.409087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:10.409094 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:10.409229 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:10.409234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.410582 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.410584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:10.411278 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:10.411287 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.412030 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.412034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:10.412112 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.412196 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:10.413489 (+ 1293us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:10.413508 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 03:45:10.413660 (+ 152us) client_negotiation.cc:240] Negotiation successful
0810 03:45:10.413808 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134}
I20260810 03:45:10.414346 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.408342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51658 (local address 127.22.134.195:39027)
0810 03:45:10.408718 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:10.408761 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:10.408777 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:45:10.408852 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:10.408855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:10.408918 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:10.409044 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:10.409337 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.410428 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.411386 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.411878 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.411988 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.412460 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:10.413308 (+ 848us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:10.413502 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:10.413704 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 03:45:10.413804 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":137,"threads_started":1}
I20260810 03:45:10.418808 24598 raft_consensus.cc:1261] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Refusing update from remote peer da54425b060f4dcb94f0d2f60af03f14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:10.418897 24431 raft_consensus.cc:1261] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 FOLLOWER]: Refusing update from remote peer da54425b060f4dcb94f0d2f60af03f14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:10.419364 24873 consensus_queue.cc:1035] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:10.419516 24836 consensus_queue.cc:1035] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:10.422422 24842 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: TxnStatusTablet state changed. Reason: New leader da54425b060f4dcb94f0d2f60af03f14. Latest consensus state: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.422559 24842 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:10.422986 24879 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: TxnStatusTablet state changed. Reason: New leader da54425b060f4dcb94f0d2f60af03f14. Latest consensus state: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.423133 24879 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:10.426661 24875 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.426894 24875 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:10.427102 24875 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.427186 24875 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P da54425b060f4dcb94f0d2f60af03f14: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:10.427523 24842 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.427644 24842 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P e80ec51c2fed4998b42a15d0ec8a1e69: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:10.429345 24879 tablet_replica.cc:439] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "da54425b060f4dcb94f0d2f60af03f14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80ec51c2fed4998b42a15d0ec8a1e69" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 34367 } } peers { permanent_uuid: "ca7f6f710a314dc19ceb77fe8f7141a0" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36737 } } peers { permanent_uuid: "da54425b060f4dcb94f0d2f60af03f14" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 39027 } } }
I20260810 03:45:10.429472 24879 tablet_replica.cc:442] T 464bd30776924f149cd4ea0100859332 P ca7f6f710a314dc19ceb77fe8f7141a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:10.439417 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.435149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51666 (local address 127.22.134.195:39027)
0810 03:45:10.435293 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:10.435298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:10.435551 (+ 253us) server_negotiation.cc:407] Connection header received
0810 03:45:10.435671 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:10.435673 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:10.435715 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:10.435781 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:10.436147 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.436942 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.438336 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.438546 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.438657 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.438952 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:10.439018 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:10.439072 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:10.439233 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 03:45:10.439277 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:45:10.452452 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.448196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:51029 (local address 127.22.134.195:39027)
0810 03:45:10.448331 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:10.448335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:10.448641 (+ 306us) server_negotiation.cc:407] Connection header received
0810 03:45:10.448799 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:10.448801 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:10.448842 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:10.448907 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:10.449359 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.449861 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.451331 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.451536 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.451627 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.452026 (+ 399us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:10.452092 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:10.452147 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:10.452277 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 03:45:10.452320 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:10.452682 24898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.448101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:39027 (local address 127.22.134.195:51029)
0810 03:45:10.448505 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:10.448523 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:10.448657 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:10.448943 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:10.448948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:10.449061 (+ 113us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:10.449239 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:10.449247 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.449969 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.449973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:10.451195 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:10.451207 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.451654 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.451658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:10.451817 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.451880 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:10.452180 (+ 300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:10.452186 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:45:10.452260 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 03:45:10.452343 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":137,"threads_started":1}
I20260810 03:45:10.506783 24275 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:10.507004 24275 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:10.509375 24275 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ec16bc8a5434375b4eab170d53c3913: Sending DeleteTablet for 3 replicas of tablet 7cc587e4a1964ff9acce72894de90349
I20260810 03:45:10.509989 24423 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc587e4a1964ff9acce72894de90349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:10 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:40246
I20260810 03:45:10.510138 24730 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc587e4a1964ff9acce72894de90349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:10 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:51644
I20260810 03:45:10.510277 24577 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cc587e4a1964ff9acce72894de90349 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:10 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:60128
I20260810 03:45:10.510433 24900 tablet_replica.cc:330] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: stopping tablet replica
I20260810 03:45:10.510594 24900 raft_consensus.cc:2229] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:10.510761 24900 raft_consensus.cc:2258] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:10.510878 24902 tablet_replica.cc:330] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: stopping tablet replica
I20260810 03:45:10.511106 24902 raft_consensus.cc:2229] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:10.511442 24902 raft_consensus.cc:2258] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:10.511811 24903 tablet_replica.cc:330] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: stopping tablet replica
I20260810 03:45:10.511946 24900 ts_tablet_manager.cc:1905] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:10.511956 24903 raft_consensus.cc:2229] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:10.512085 24903 raft_consensus.cc:2258] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:10.512496 24902 ts_tablet_manager.cc:1905] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:10.512780 24903 ts_tablet_manager.cc:1905] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:10.515535 24900 ts_tablet_manager.cc:1918] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:10.515600 24902 ts_tablet_manager.cc:1918] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:10.515693 24902 log.cc:1196] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/7cc587e4a1964ff9acce72894de90349
I20260810 03:45:10.515797 24900 log.cc:1196] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/7cc587e4a1964ff9acce72894de90349
I20260810 03:45:10.516037 24902 ts_tablet_manager.cc:1939] T 7cc587e4a1964ff9acce72894de90349 P da54425b060f4dcb94f0d2f60af03f14: Deleting consensus metadata
I20260810 03:45:10.516079 24903 ts_tablet_manager.cc:1918] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:10.516171 24903 log.cc:1196] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/7cc587e4a1964ff9acce72894de90349
I20260810 03:45:10.516327 24900 ts_tablet_manager.cc:1939] T 7cc587e4a1964ff9acce72894de90349 P e80ec51c2fed4998b42a15d0ec8a1e69: Deleting consensus metadata
I20260810 03:45:10.516444 24903 ts_tablet_manager.cc:1939] T 7cc587e4a1964ff9acce72894de90349 P ca7f6f710a314dc19ceb77fe8f7141a0: Deleting consensus metadata
I20260810 03:45:10.516880 24260 catalog_manager.cc:4841] TS da54425b060f4dcb94f0d2f60af03f14 (127.22.134.195:39027): tablet 7cc587e4a1964ff9acce72894de90349 (table test-table [id=63e2c1209dc7479b95db766490f27ace]) successfully deleted
I20260810 03:45:10.517169 24260 catalog_manager.cc:4841] TS ca7f6f710a314dc19ceb77fe8f7141a0 (127.22.134.194:36737): tablet 7cc587e4a1964ff9acce72894de90349 (table test-table [id=63e2c1209dc7479b95db766490f27ace]) successfully deleted
I20260810 03:45:10.517169 24258 catalog_manager.cc:4841] TS e80ec51c2fed4998b42a15d0ec8a1e69 (127.22.134.193:34367): tablet 7cc587e4a1964ff9acce72894de90349 (table test-table [id=63e2c1209dc7479b95db766490f27ace]) successfully deleted
Aug 10 03:45:10 dist-test-slave-qg60 krb5kdc[24226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333509, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:10.532612 24906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.517745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40260 (local address 127.22.134.193:34367)
0810 03:45:10.520953 (+ 3208us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:10.520958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:10.520978 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:45:10.521027 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:10.521030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:10.521083 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:10.521194 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:10.522143 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.522972 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.523933 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.524430 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.524552 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.528191 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:10.528210 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:10.528229 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:10.528263 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:10.530655 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:10.531137 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:10.531144 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:10.531146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:10.531252 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:10.531539 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:10.531542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:10.531543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:10.531884 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:10.532137 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:10.532266 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 03:45:10.532413 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3114,"thread_start_us":77,"threads_started":1}
W20260810 03:45:10.533403 24487 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40260
I20260810 03:45:10.545815 24910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:10.535423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47760 (local address 127.22.134.254:35523)
0810 03:45:10.535755 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:10.535760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:10.535775 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:45:10.535915 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:10.535918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:10.535979 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:10.536107 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:10.537023 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.537917 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.539045 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:10.539400 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:10.539526 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:10.541134 (+ 1608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:10.541138 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:10.541141 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:10.541173 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:10.543355 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:10.543813 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:10.543816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:10.543818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:10.544063 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:10.544406 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:10.544410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:10.544412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:10.544817 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:10.545002 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:10.545392 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 03:45:10.545562 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":114,"threads_started":1}
W20260810 03:45:10.546353 24275 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47760
I20260810 03:45:10.547957 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 24352
I20260810 03:45:10.563637 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 24506
I20260810 03:45:10.572110 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 24663
I20260810 03:45:10.581552 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 24240
2026-08-10T03:45:10Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3244 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:10 dist-test-slave-qg60 krb5kdc[24913](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:10 dist-test-slave-qg60 krb5kdc[24913](info): set up 2 sockets
Aug 10 03:45:10 dist-test-slave-qg60 krb5kdc[24913](info): commencing operation
krb5kdc: starting...
W20260810 03:45:11.734622 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:11 dist-test-slave-qg60 krb5kdc[24913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:11.872107 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:41329
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:41329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:11.987543 24928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:11.987825 24928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:11.987869 24928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:11.992026 24928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:11.992097 24928 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 03:45:11.992115 24928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:11.992139 24928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:11.992177 24928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:11.992216 24928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:11.997601 24928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:41329
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:41329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:11.998721 24928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:11.999789 24928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:12.008823 24933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:12.008823 24934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:12.008841 24936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:12.009179 24928 server_base.cc:1034] running on GCE node
I20260810 03:45:12.009819 24928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:12.010942 24928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:12.012171 24928 hybrid_clock.cc:648] HybridClock initialized: now 1786333512012159 us; error 33 us; skew 500 ppm
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:12.015244 24928 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:12.016193 24928 webserver.cc:460] Webserver started at http://127.22.134.254:36061/ using document root <none> and password file <none>
I20260810 03:45:12.016829 24928 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:12.016920 24928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:12.017163 24928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:12.019413 24928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "e8ec8a6f82c14d1289df4aa872743119"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "3b85a9c7b517b65f095dcf92277621c5"
server_key_iv: "6fa32c4488276c5e28887625e6cf75b6"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.020043 24928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "e8ec8a6f82c14d1289df4aa872743119"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "3b85a9c7b517b65f095dcf92277621c5"
server_key_iv: "6fa32c4488276c5e28887625e6cf75b6"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.024245 24928 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 03:45:12.027020 24945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:12.028451 24928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:12.028622 24928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "e8ec8a6f82c14d1289df4aa872743119"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "3b85a9c7b517b65f095dcf92277621c5"
server_key_iv: "6fa32c4488276c5e28887625e6cf75b6"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.028805 24928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:12.057652 24928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:12.061496 24928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:12.061733 24928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:12.070572 24928 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:41329
I20260810 03:45:12.070611 25012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:41329 every 8 connection(s)
I20260810 03:45:12.071579 24928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:12.074473 25013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:12.079916 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 24928
I20260810 03:45:12.080010 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:12.080269 23067 external_mini_cluster.cc:1428] Setting key 11af83ed9f3d9c752377e5b80d5c0bef
I20260810 03:45:12.080374 25013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: Bootstrap starting.
I20260810 03:45:12.083004 25013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:12.083750 25013 log.cc:824] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:12.085795 25013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: No bootstrap required, opened a new log
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:12.089916 25013 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ec8a6f82c14d1289df4aa872743119" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41329 } }
I20260810 03:45:12.090152 25013 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:12.090209 25013 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ec8a6f82c14d1289df4aa872743119, State: Initialized, Role: FOLLOWER
I20260810 03:45:12.090694 25013 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ec8a6f82c14d1289df4aa872743119" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41329 } }
I20260810 03:45:12.090821 25013 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:12.090903 25013 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:12.091015 25013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:12.091972 25013 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ec8a6f82c14d1289df4aa872743119" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41329 } }
I20260810 03:45:12.092370 25013 leader_election.cc:302] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8ec8a6f82c14d1289df4aa872743119; no voters:
I20260810 03:45:12.092769 25013 leader_election.cc:288] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:12.092937 25018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:12.093259 25018 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [term 1 LEADER]: Becoming Leader. State: Replica: e8ec8a6f82c14d1289df4aa872743119, State: Running, Role: LEADER
I20260810 03:45:12.093657 25018 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ec8a6f82c14d1289df4aa872743119" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41329 } }
I20260810 03:45:12.094084 25013 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:12.095176 25018 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8ec8a6f82c14d1289df4aa872743119. Latest consensus state: current_term: 1 leader_uuid: "e8ec8a6f82c14d1289df4aa872743119" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ec8a6f82c14d1289df4aa872743119" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41329 } } }
I20260810 03:45:12.095382 25018 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:12.095659 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.081708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58586 (local address 127.22.134.254:41329)
0810 03:45:12.082171 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.082186 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.082220 (+ 34us) server_negotiation.cc:407] Connection header received
0810 03:45:12.082870 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.082887 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.083268 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.083596 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:12.084408 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.085440 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.086342 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.086814 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.086976 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.089863 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:12.089868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:12.089884 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:12.089914 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:12.091944 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.092445 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.092450 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.092456 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.092695 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.093049 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.093054 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.093056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.093654 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:12.093873 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.094177 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.094545 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":150,"threads_started":1}
I20260810 03:45:12.095625 25020 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8ec8a6f82c14d1289df4aa872743119" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ec8a6f82c14d1289df4aa872743119" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41329 } } }
I20260810 03:45:12.095757 25020 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:12.096702 25030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:12.100140 25030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:12.109110 25030 catalog_manager.cc:1347] Generated new cluster ID: f0faa276bd4840b89100425860fec105
I20260810 03:45:12.109190 25030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:12.117069 25030 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:12.118080 25030 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:12.126658 25030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: Generated new TSK 0
I20260810 03:45:12.127552 25030 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:12.166186 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:41329
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:12.292707 25042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:12.293071 25042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:12.293181 25042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:12.297932 25042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:12.297997 25042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:12.298046 25042 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 03:45:12.298089 25042 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:12.298161 25042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:12.303848 25042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:41329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:12.304935 25042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:12.305955 25042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:12.316354 25050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:12.316408 25047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:12.316368 25048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:12.316624 25042 server_base.cc:1034] running on GCE node
I20260810 03:45:12.317165 25042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:12.317873 25042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:12.319108 25042 hybrid_clock.cc:648] HybridClock initialized: now 1786333512319074 us; error 47 us; skew 500 ppm
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:12.327965 25042 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:12.329061 25042 webserver.cc:460] Webserver started at http://127.22.134.193:41593/ using document root <none> and password file <none>
I20260810 03:45:12.329660 25042 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:12.329726 25042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:12.329909 25042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:12.332109 25042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "65e4b0f555204ffda7e6723d947b4d3a"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "07ded664392bfba4f2c2f6c4cb1b5d71"
server_key_iv: "536ae9ea2983dc314c2bfb01e7f8a2cb"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.332718 25042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "65e4b0f555204ffda7e6723d947b4d3a"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "07ded664392bfba4f2c2f6c4cb1b5d71"
server_key_iv: "536ae9ea2983dc314c2bfb01e7f8a2cb"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.336922 25042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:12.339412 25058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:12.340706 25042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:12.340875 25042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "65e4b0f555204ffda7e6723d947b4d3a"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "07ded664392bfba4f2c2f6c4cb1b5d71"
server_key_iv: "536ae9ea2983dc314c2bfb01e7f8a2cb"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.340993 25042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:12.364591 25042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:12.368280 25042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:12.368517 25042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:12.370178 25042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:12.370263 25042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:12.370343 25042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:12.370396 25042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:12.382879 25042 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:33237
I20260810 03:45:12.382937 25188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:33237 every 8 connection(s)
I20260810 03:45:12.383872 25042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:12.384721 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 25042
I20260810 03:45:12.384873 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:12.385171 23067 external_mini_cluster.cc:1428] Setting key 2df4fc4e1301d18ed8e8dceee131775b
I20260810 03:45:12.385165 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.370984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:43449 (local address 127.22.134.254:41329)
0810 03:45:12.371163 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.371169 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.372533 (+ 1364us) server_negotiation.cc:407] Connection header received
0810 03:45:12.373745 (+ 1212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.373748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.373810 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.373904 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:12.375254 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.375894 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.377296 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.377652 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.377769 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.380884 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:12.380888 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:12.380891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:12.380924 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:12.382610 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.383312 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.383316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.383318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.383407 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.383775 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.383779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.383781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.384002 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:12.384122 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.384871 (+ 749us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.385001 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 03:45:12.386030 25068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.371904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:41329 (local address 127.22.134.193:43449)
0810 03:45:12.372359 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.372410 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.373496 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.374092 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.374100 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.374435 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:12.375110 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.375126 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.376017 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.376021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.377173 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.377183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.377819 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.377823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.378049 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.378733 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:12.378762 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:12.380668 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:12.382802 (+ 2134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.382811 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.382831 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.383195 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.383523 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.383527 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.383529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.383672 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.384119 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:12.384125 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:12.384425 (+ 300us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.384620 (+ 195us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.385010 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":134,"threads_started":1}
I20260810 03:45:12.387621 25189 heartbeater.cc:347] Connected to a master server at 127.22.134.254:41329
I20260810 03:45:12.387789 25189 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:12.388409 25189 heartbeater.cc:511] Master 127.22.134.254:41329 requested a full tablet report, sending...
I20260810 03:45:12.390123 24962 ts_manager.cc:194] Registered new tserver with Master: 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237)
I20260810 03:45:12.391927 24962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:43449
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:12.398674 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.389882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:41329 (local address 127.22.134.193:33913)
0810 03:45:12.390275 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.390291 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.390398 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.390652 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.390655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.390854 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:12.390965 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.390971 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.391804 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.391807 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.392542 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.392552 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.393310 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.393314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.393411 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.394081 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:12.394096 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:12.394545 (+ 449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:12.397109 (+ 2564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.397111 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.397113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.397311 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.397649 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.397651 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.397653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.397729 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.398208 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:12.398211 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:12.398287 (+ 76us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.398371 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.398479 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":119,"threads_started":1}
I20260810 03:45:12.398692 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.389967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:33913 (local address 127.22.134.254:41329)
0810 03:45:12.390091 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.390096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.390356 (+ 260us) server_negotiation.cc:407] Connection header received
0810 03:45:12.390502 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.390505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.390552 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.390637 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:12.391079 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.391681 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.392770 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.393177 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.393324 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.394745 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:12.394752 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:12.394759 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:12.394795 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:12.396943 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.397423 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.397429 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.397431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.397537 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.397819 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.397824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.397826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.398095 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:12.398214 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.398440 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.398568 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":55}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:12.420497 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:41329
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:12.539348 25199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:12.539667 25199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:12.539757 25199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:12.544060 25199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:12.544165 25199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:12.544242 25199 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 03:45:12.544293 25199 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:12.544359 25199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:12.549890 25199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:41329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:12.551036 25199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:12.552105 25199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:12.561831 25204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:12.561765 25207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:12.561765 25205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:12.562325 25199 server_base.cc:1034] running on GCE node
I20260810 03:45:12.562737 25199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:12.563371 25199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:12.564577 25199 hybrid_clock.cc:648] HybridClock initialized: now 1786333512564562 us; error 37 us; skew 500 ppm
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:12.567936 25199 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:12.568981 25199 webserver.cc:460] Webserver started at http://127.22.134.194:38479/ using document root <none> and password file <none>
I20260810 03:45:12.569566 25199 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:12.569657 25199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:12.569888 25199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:12.572037 25199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "52b715f9796d4d339ec567e93ae7457a"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "8b95ce2bcb69a6e53c7f68f5aaad3515"
server_key_iv: "fb95056fb9582eb5bac3eef48b54106d"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.572665 25199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "52b715f9796d4d339ec567e93ae7457a"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "8b95ce2bcb69a6e53c7f68f5aaad3515"
server_key_iv: "fb95056fb9582eb5bac3eef48b54106d"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.576545 25199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 03:45:12.579020 25215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:12.580353 25199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:12.580489 25199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "52b715f9796d4d339ec567e93ae7457a"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "8b95ce2bcb69a6e53c7f68f5aaad3515"
server_key_iv: "fb95056fb9582eb5bac3eef48b54106d"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.580613 25199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:12.593238 25199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:12.596975 25199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:12.597175 25199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:12.598699 25199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:12.598771 25199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:12.598860 25199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:12.598899 25199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:12.610221 25199 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:32771
I20260810 03:45:12.610256 25337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:32771 every 8 connection(s)
I20260810 03:45:12.611348 25199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:12.612684 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.599494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:58705 (local address 127.22.134.254:41329)
0810 03:45:12.599684 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.599691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.600510 (+ 819us) server_negotiation.cc:407] Connection header received
0810 03:45:12.601487 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.601491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.601550 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.601638 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:12.603008 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.603665 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.604965 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.605191 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.605304 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.608668 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:12.608676 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:12.608682 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:12.608719 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:12.610530 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.611017 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.611021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.611023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.611124 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.611517 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.611522 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.611523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.611725 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:12.611845 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.612455 (+ 610us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.612565 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 03:45:12.613538 25224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.599882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:41329 (local address 127.22.134.194:58705)
0810 03:45:12.600344 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.600395 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.601280 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.601970 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.601979 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.602321 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:12.602861 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.602876 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.603788 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.603792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.604845 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.604854 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.605342 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.605347 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.605566 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.606254 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:12.606288 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:12.608464 (+ 2176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:12.610642 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.610646 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.610657 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.610911 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.611244 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.611247 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.611248 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.611416 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.611901 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:12.611906 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:12.612208 (+ 302us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.612408 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.612662 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":141,"threads_started":1}
I20260810 03:45:12.614854 25338 heartbeater.cc:347] Connected to a master server at 127.22.134.254:41329
I20260810 03:45:12.614991 25338 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:12.615549 25338 heartbeater.cc:511] Master 127.22.134.254:41329 requested a full tablet report, sending...
I20260810 03:45:12.616624 24963 ts_manager.cc:194] Registered new tserver with Master: 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771)
I20260810 03:45:12.617449 24963 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:58705
I20260810 03:45:12.618909 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 25199
I20260810 03:45:12.619095 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:12.619395 23067 external_mini_cluster.cc:1428] Setting key a1bfe401e1438ccf165542df80871f3f
I20260810 03:45:12.624926 25344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.617068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:41329 (local address 127.22.134.194:36913)
0810 03:45:12.617429 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.617440 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.617524 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.617823 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.617826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.618016 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:12.618154 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.618160 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.619015 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.619019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.619753 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.619762 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.620277 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.620280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.620355 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.620980 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:12.620994 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:12.621464 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:12.623352 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.623354 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.623356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.623546 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.623853 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.623855 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.623857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.623929 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.624423 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:12.624425 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:12.624499 (+ 74us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.624593 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.624705 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":19,"thread_start_us":120,"threads_started":1}
I20260810 03:45:12.625074 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.617182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:36913 (local address 127.22.134.254:41329)
0810 03:45:12.617301 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.617305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.617516 (+ 211us) server_negotiation.cc:407] Connection header received
0810 03:45:12.617653 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.617656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.617703 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.617805 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:12.618262 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.618832 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.619866 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.620156 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.620252 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.621606 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:12.621608 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:12.621610 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:12.621631 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:12.623243 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.623665 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.623669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.623672 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.623765 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.624015 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.624020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.624023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.624333 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:12.624440 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.624673 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.624833 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:12.648288 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:41329
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:12.766245 25347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:12.766507 25347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:12.766589 25347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:12.770701 25347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:12.770766 25347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:12.770835 25347 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 03:45:12.770864 25347 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:12.770943 25347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:12.776583 25347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:41329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:12.777752 25347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:12.778810 25347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:12.788936 25353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:12.788930 25355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:12.789137 25347 server_base.cc:1034] running on GCE node
W20260810 03:45:12.788933 25352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:12.789754 25347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:12.790418 25347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:12.791622 25347 hybrid_clock.cc:648] HybridClock initialized: now 1786333512791606 us; error 32 us; skew 500 ppm
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:12.794885 25347 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:12.795936 25347 webserver.cc:460] Webserver started at http://127.22.134.195:44969/ using document root <none> and password file <none>
I20260810 03:45:12.796512 25347 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:12.796603 25347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:12.796875 25347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:12.799118 25347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "d4f3f40a1b0847f592c206ff2a930f91"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "3dd0bb532cf3784b324ab985a1b03916"
server_key_iv: "80e1e2c04b18048a5f3bc8ee5949ffc6"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.799700 25347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "d4f3f40a1b0847f592c206ff2a930f91"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "3dd0bb532cf3784b324ab985a1b03916"
server_key_iv: "80e1e2c04b18048a5f3bc8ee5949ffc6"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.803745 25347 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 03:45:12.806371 25362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:12.807649 25347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260810 03:45:12.807778 25347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "d4f3f40a1b0847f592c206ff2a930f91"
format_stamp: "Formatted at 2026-08-10 03:45:12 on dist-test-slave-qg60"
server_key: "3dd0bb532cf3784b324ab985a1b03916"
server_key_iv: "80e1e2c04b18048a5f3bc8ee5949ffc6"
server_key_version: "encryptionkey@0"
I20260810 03:45:12.807888 25347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:12.828331 25347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:12.831710 25347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:12.831929 25347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:12.833683 25347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:12.833737 25347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:12.833812 25347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:12.833853 25347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:12.845432 25347 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:40143
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:12.845466 25485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:40143 every 8 connection(s)
I20260810 03:45:12.846331 25347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:12.849720 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.834615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:37753 (local address 127.22.134.254:41329)
0810 03:45:12.834764 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.834770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.836513 (+ 1743us) server_negotiation.cc:407] Connection header received
0810 03:45:12.837944 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.837950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.838016 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.838120 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:12.839849 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.840837 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.842691 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.842904 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.842988 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.846159 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:12.846165 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:12.846170 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:12.846201 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:12.847807 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.848322 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.848324 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.848325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.848404 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.848699 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.848702 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.848703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.848934 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:12.849024 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.849471 (+ 447us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.849595 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:45:12.850570 25371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.835198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:41329 (local address 127.22.134.195:37753)
0810 03:45:12.836297 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.836361 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.837647 (+ 1286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.838318 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.838326 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.838880 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:12.839668 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.839694 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.840976 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.840982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.842558 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.842570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.843076 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.843081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.843316 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.844084 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:12.844111 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:12.845965 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:12.847930 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.847934 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.847945 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.848227 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.848482 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.848484 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.848486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.848618 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.849033 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:12.849038 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:12.849259 (+ 221us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.849417 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.849689 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"thread_start_us":152,"threads_started":1}
I20260810 03:45:12.851943 25486 heartbeater.cc:347] Connected to a master server at 127.22.134.254:41329
I20260810 03:45:12.852157 25486 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:12.852655 25486 heartbeater.cc:511] Master 127.22.134.254:41329 requested a full tablet report, sending...
I20260810 03:45:12.853716 24963 ts_manager.cc:194] Registered new tserver with Master: d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:12.854485 24963 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:37753
I20260810 03:45:12.856468 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 25347
I20260810 03:45:12.856599 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:12.857165 23067 external_mini_cluster.cc:1428] Setting key 17fa917906d95261186093af8b9a133c
I20260810 03:45:12.859439 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:45:12.861635 25492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.854049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:41329 (local address 127.22.134.195:45811)
0810 03:45:12.854338 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.854352 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.854447 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.854680 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.854683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.854881 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:12.854972 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.854977 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.855721 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.855723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.856270 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.856277 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.856849 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.856853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.857066 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.857733 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:12.857744 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:12.858140 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:12.860086 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.860088 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.860090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.860284 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.860582 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:12.860584 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:12.860585 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:12.860658 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:12.861177 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:12.861179 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:12.861265 (+ 86us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.861361 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.861496 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":111,"threads_started":1}
I20260810 03:45:12.861812 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.854215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:45811 (local address 127.22.134.254:41329)
0810 03:45:12.854336 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.854339 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.854417 (+ 78us) server_negotiation.cc:407] Connection header received
0810 03:45:12.854523 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.854526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.854563 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.854659 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:12.855090 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.855590 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.856385 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.856695 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.856844 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.858272 (+ 1428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:12.858279 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:12.858283 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:12.858307 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:12.859951 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.860385 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.860391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.860395 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.860486 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.860777 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.860783 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.860787 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.861040 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:12.861160 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.861442 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.861579 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:45:12 dist-test-slave-qg60 krb5kdc[24913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:12.888659 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.879985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58594 (local address 127.22.134.254:41329)
0810 03:45:12.880125 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.880129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.880141 (+ 12us) server_negotiation.cc:407] Connection header received
0810 03:45:12.880184 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.880186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.880225 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.880318 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:12.881159 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.881689 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.882537 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.882762 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.882873 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.885688 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:12.885691 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:12.885693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:12.885719 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:12.887119 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.887510 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.887513 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.887514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.887595 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:12.887886 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:12.887888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:12.887889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:12.888116 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:12.888224 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.888426 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.888526 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:45:12.891619 24963 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58594:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:12.894783 24963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:12.909657 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.903586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51886 (local address 127.22.134.194:32771)
0810 03:45:12.904268 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.904281 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.904305 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:45:12.904386 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.904391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.904613 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.905191 (+ 578us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:12.905336 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.906525 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.908211 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.908914 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.909085 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.909230 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.909379 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.909473 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":110,"threads_started":1}
I20260810 03:45:12.909651 25503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.903377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32771 (local address 127.0.0.1:51886)
0810 03:45:12.903744 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.903800 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.903933 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.904837 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.904844 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.904870 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:12.905014 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.905020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.906648 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.906652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.908061 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.908070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.909051 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.909056 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.909181 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.909218 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.909347 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.909473 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":102,"thread_start_us":91,"threads_started":1}
I20260810 03:45:12.909703 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.903794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:40143 (local address 127.0.0.1:47516)
0810 03:45:12.904165 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.904178 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.904261 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.905067 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.905071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.905093 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:12.905194 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.905205 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.906450 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.906455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.908116 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.908122 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.909263 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.909267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.909351 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.909374 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.909429 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.909507 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":174,"thread_start_us":91,"threads_started":1}
I20260810 03:45:12.910254 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.904223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47516 (local address 127.22.134.195:40143)
0810 03:45:12.904563 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.904574 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.904608 (+ 34us) server_negotiation.cc:407] Connection header received
0810 03:45:12.904683 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.904687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.904910 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.905352 (+ 442us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:12.905467 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.906326 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.908256 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.909121 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.909814 (+ 693us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.909958 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.910000 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.910092 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":121,"threads_started":1}
I20260810 03:45:12.910408 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.904170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:33237 (local address 127.0.0.1:44660)
0810 03:45:12.905165 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:12.905178 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:12.905275 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:12.905705 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:12.905708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:12.905727 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:12.905811 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.905816 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.906978 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.906981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.908109 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:12.908120 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.909443 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.909446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:12.909525 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.909551 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:45:12.909638 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 03:45:12.909695 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":936,"mutex_wait_us":107,"thread_start_us":77,"threads_started":1}
I20260810 03:45:12.910862 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:12.904532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44660 (local address 127.22.134.193:33237)
0810 03:45:12.904913 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:12.904919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:12.905270 (+ 351us) server_negotiation.cc:407] Connection header received
0810 03:45:12.905384 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:12.905389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:12.905552 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:12.905706 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:12.905922 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.906873 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.908256 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:12.909121 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:12.909256 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:12.909382 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:12.909767 (+ 385us) server_negotiation.cc:299] Negotiation successful
0810 03:45:12.910739 (+ 972us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":90,"threads_started":1}
I20260810 03:45:12.913005 25267 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4dbce1da724e649b264b7c6d1b64ef (DEFAULT_TABLE table=test-table [id=587ec20709e04085b17fa8c2cd04d931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:12.913139 25414 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4dbce1da724e649b264b7c6d1b64ef (DEFAULT_TABLE table=test-table [id=587ec20709e04085b17fa8c2cd04d931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:12.913137 25112 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4dbce1da724e649b264b7c6d1b64ef (DEFAULT_TABLE table=test-table [id=587ec20709e04085b17fa8c2cd04d931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:12.913944 25267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4dbce1da724e649b264b7c6d1b64ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:12.914155 25112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4dbce1da724e649b264b7c6d1b64ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:12.914196 25414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4dbce1da724e649b264b7c6d1b64ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:12.921126 25510 tablet_bootstrap.cc:492] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Bootstrap starting.
I20260810 03:45:12.922115 25511 tablet_bootstrap.cc:492] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Bootstrap starting.
I20260810 03:45:12.923499 25510 tablet_bootstrap.cc:654] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:12.923921 25511 tablet_bootstrap.cc:654] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:12.924377 25510 log.cc:824] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:12.924650 25511 log.cc:824] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:12.925156 25512 tablet_bootstrap.cc:492] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Bootstrap starting.
I20260810 03:45:12.926676 25510 tablet_bootstrap.cc:492] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: No bootstrap required, opened a new log
I20260810 03:45:12.926887 25510 ts_tablet_manager.cc:1397] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 03:45:12.926985 25511 tablet_bootstrap.cc:492] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: No bootstrap required, opened a new log
I20260810 03:45:12.927167 25511 ts_tablet_manager.cc:1397] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 03:45:12.927426 25512 tablet_bootstrap.cc:654] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:12.928265 25512 log.cc:824] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:12.930516 25512 tablet_bootstrap.cc:492] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: No bootstrap required, opened a new log
I20260810 03:45:12.930708 25512 ts_tablet_manager.cc:1397] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:45:12.930522 25510 raft_consensus.cc:348] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:12.930796 25510 raft_consensus.cc:374] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:12.930863 25510 raft_consensus.cc:729] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b715f9796d4d339ec567e93ae7457a, State: Initialized, Role: FOLLOWER
I20260810 03:45:12.931386 25510 consensus_queue.cc:260] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:12.932029 25338 heartbeater.cc:503] Master 127.22.134.254:41329 was elected leader, sending a full tablet report...
I20260810 03:45:12.932107 25511 raft_consensus.cc:348] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:12.932356 25511 raft_consensus.cc:374] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:12.932404 25511 raft_consensus.cc:729] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e4b0f555204ffda7e6723d947b4d3a, State: Initialized, Role: FOLLOWER
I20260810 03:45:12.932890 25511 consensus_queue.cc:260] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:12.933543 25510 ts_tablet_manager.cc:1428] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260810 03:45:12.933867 25511 ts_tablet_manager.cc:1428] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 03:45:12.934034 25189 heartbeater.cc:503] Master 127.22.134.254:41329 was elected leader, sending a full tablet report...
I20260810 03:45:12.935940 25512 raft_consensus.cc:348] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:12.936219 25512 raft_consensus.cc:374] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:12.936283 25512 raft_consensus.cc:729] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f3f40a1b0847f592c206ff2a930f91, State: Initialized, Role: FOLLOWER
I20260810 03:45:12.936719 25512 consensus_queue.cc:260] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:12.937425 25486 heartbeater.cc:503] Master 127.22.134.254:41329 was elected leader, sending a full tablet report...
I20260810 03:45:12.937620 25512 ts_tablet_manager.cc:1428] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 03:45:13.088196 25516 raft_consensus.cc:482] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:13.088451 25516 raft_consensus.cc:504] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.089730 25516 leader_election.cc:288] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:13.094429 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.090182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:38925 (local address 127.22.134.195:40143)
0810 03:45:13.090322 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:13.090327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:13.090462 (+ 135us) server_negotiation.cc:407] Connection header received
0810 03:45:13.090670 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:13.090677 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:13.090738 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:13.090820 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:13.091195 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.091746 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.093139 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.093776 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.093901 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.093956 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:13.094209 (+ 253us) server_negotiation.cc:299] Negotiation successful
0810 03:45:13.094279 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:13.094458 25224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.090089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:40143 (local address 127.22.134.194:38925)
0810 03:45:13.090334 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:13.090365 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:13.090524 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:13.090837 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:13.090840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:13.090858 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:13.091063 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.091072 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.091862 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.091865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.093005 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.093015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.093909 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.093912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.094047 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.094073 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:45:13.094195 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 03:45:13.094284 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":5}
I20260810 03:45:13.095197 25434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d4dbce1da724e649b264b7c6d1b64ef" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4f3f40a1b0847f592c206ff2a930f91" is_pre_election: true
I20260810 03:45:13.095500 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.090288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:40515 (local address 127.22.134.193:33237)
0810 03:45:13.090414 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:13.090418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:13.090733 (+ 315us) server_negotiation.cc:407] Connection header received
0810 03:45:13.090842 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:13.090845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:13.090893 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:13.091010 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:13.091277 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.091869 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.094200 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.094862 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.095006 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.095052 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:13.095290 (+ 238us) server_negotiation.cc:299] Negotiation successful
0810 03:45:13.095389 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:45:13.095578 25520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.090103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:33237 (local address 127.22.134.194:40515)
0810 03:45:13.090614 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:13.090630 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:13.090748 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:13.091005 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:13.091007 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:13.091021 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:13.091152 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.091158 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.091992 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.091996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.094022 (+ 2026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.094031 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.095092 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.095096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.095167 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.095185 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 03:45:13.095250 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 03:45:13.095301 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":44,"thread_start_us":255,"threads_started":1}
I20260810 03:45:13.095584 25434 raft_consensus.cc:2454] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 0.
I20260810 03:45:13.096115 25219 leader_election.cc:302] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, d4f3f40a1b0847f592c206ff2a930f91; no voters:
I20260810 03:45:13.096266 25136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d4dbce1da724e649b264b7c6d1b64ef" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a" is_pre_election: true
I20260810 03:45:13.096414 25516 raft_consensus.cc:2781] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:13.096511 25516 raft_consensus.cc:482] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:13.096563 25516 raft_consensus.cc:3037] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:13.096578 25136 raft_consensus.cc:2454] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 0.
W20260810 03:45:13.097360 25487 tablet.cc:2369] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:13.097747 25516 raft_consensus.cc:504] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.098121 25516 leader_election.cc:288] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 election: Requested vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:13.098481 25136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d4dbce1da724e649b264b7c6d1b64ef" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a"
I20260810 03:45:13.098465 25434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d4dbce1da724e649b264b7c6d1b64ef" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4f3f40a1b0847f592c206ff2a930f91"
I20260810 03:45:13.098598 25434 raft_consensus.cc:3037] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:13.098618 25136 raft_consensus.cc:3037] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:13.099675 25136 raft_consensus.cc:2454] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 1.
I20260810 03:45:13.100003 25217 leader_election.cc:302] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, 65e4b0f555204ffda7e6723d947b4d3a; no voters:
I20260810 03:45:13.100205 25434 raft_consensus.cc:2454] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 1.
I20260810 03:45:13.100237 25516 raft_consensus.cc:2781] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:13.100441 25516 raft_consensus.cc:686] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 1 LEADER]: Becoming Leader. State: Replica: 52b715f9796d4d339ec567e93ae7457a, State: Running, Role: LEADER
I20260810 03:45:13.100848 25516 consensus_queue.cc:237] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.104063 24963 catalog_manager.cc:5495] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a reported cstate change: term changed from 0 to 1, leader changed from <none> to 52b715f9796d4d339ec567e93ae7457a (127.22.134.194). New cstate: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } health_report { overall_health: UNKNOWN } } }
W20260810 03:45:13.112599 25339 tablet.cc:2369] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:45:13.135298 25190 tablet.cc:2369] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 03:45:13 dist-test-slave-qg60 krb5kdc[24913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333512, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:13.175551 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.166705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:41329 (local address 127.0.0.1:58604)
0810 03:45:13.167013 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:13.167028 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:13.167154 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:13.167393 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:13.167395 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:13.167803 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:13.167904 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.167911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.168709 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.168712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.169386 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.169397 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.169851 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.169853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.169914 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.170575 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:13.170587 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:13.172288 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:13.173974 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:13.173983 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:13.173988 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:13.174247 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:13.174538 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:13.174541 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:13.174543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:13.174627 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:13.174987 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:13.174993 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:13.175179 (+ 186us) client_negotiation.cc:769] Sending connection context
0810 03:45:13.175278 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 03:45:13.175401 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":100,"threads_started":1}
I20260810 03:45:13.175591 25016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.166816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58604 (local address 127.22.134.254:41329)
0810 03:45:13.166991 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:13.166996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:13.167121 (+ 125us) server_negotiation.cc:407] Connection header received
0810 03:45:13.167234 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:13.167236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:13.167278 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:13.167350 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:13.168028 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.168568 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.169508 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.169756 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.169835 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.172429 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:13.172432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:13.172434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:13.172455 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:13.173869 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:13.174356 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:13.174359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:13.174360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:13.174440 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:13.174706 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:13.174708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:13.174709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:13.174898 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:13.174979 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:13.175366 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 03:45:13.175470 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260810 03:45:13.179877 24963 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:58604:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 03:45:13.180672 24963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:13.186306 25414 tablet_service.cc:1467] Processing CreateTablet for tablet 9858fabdff5b46119b92f55c714c0571 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=de89e53bca274f4fb8c6e48f6e352339]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:13.186153 25112 tablet_service.cc:1467] Processing CreateTablet for tablet 9858fabdff5b46119b92f55c714c0571 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=de89e53bca274f4fb8c6e48f6e352339]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:13.186131 25267 tablet_service.cc:1467] Processing CreateTablet for tablet 9858fabdff5b46119b92f55c714c0571 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=de89e53bca274f4fb8c6e48f6e352339]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:13.186944 25414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9858fabdff5b46119b92f55c714c0571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:13.186947 25112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9858fabdff5b46119b92f55c714c0571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:13.186947 25267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9858fabdff5b46119b92f55c714c0571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:13.189908 25512 tablet_bootstrap.cc:492] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: Bootstrap starting.
I20260810 03:45:13.190160 25511 tablet_bootstrap.cc:492] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: Bootstrap starting.
I20260810 03:45:13.190982 25512 tablet_bootstrap.cc:654] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:13.191143 25510 tablet_bootstrap.cc:492] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: Bootstrap starting.
I20260810 03:45:13.191406 25511 tablet_bootstrap.cc:654] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:13.192363 25510 tablet_bootstrap.cc:654] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:13.192858 25512 tablet_bootstrap.cc:492] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: No bootstrap required, opened a new log
I20260810 03:45:13.192858 25511 tablet_bootstrap.cc:492] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: No bootstrap required, opened a new log
I20260810 03:45:13.192940 25512 ts_tablet_manager.cc:1397] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:13.192940 25511 ts_tablet_manager.cc:1397] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:13.193444 25511 raft_consensus.cc:348] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.193444 25512 raft_consensus.cc:348] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.193573 25512 raft_consensus.cc:374] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:13.193573 25511 raft_consensus.cc:374] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:13.193611 25512 raft_consensus.cc:729] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f3f40a1b0847f592c206ff2a930f91, State: Initialized, Role: FOLLOWER
I20260810 03:45:13.193611 25511 raft_consensus.cc:729] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e4b0f555204ffda7e6723d947b4d3a, State: Initialized, Role: FOLLOWER
I20260810 03:45:13.193755 25510 tablet_bootstrap.cc:492] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: No bootstrap required, opened a new log
I20260810 03:45:13.193743 25511 consensus_queue.cc:260] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.193743 25512 consensus_queue.cc:260] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.193856 25510 ts_tablet_manager.cc:1397] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 03:45:13.194005 25512 ts_tablet_manager.cc:1428] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:13.194005 25511 ts_tablet_manager.cc:1428] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:13.194265 25518 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.194422 25518 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:13.194396 25510 raft_consensus.cc:348] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.194588 25510 raft_consensus.cc:374] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:13.194682 25510 raft_consensus.cc:729] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b715f9796d4d339ec567e93ae7457a, State: Initialized, Role: FOLLOWER
I20260810 03:45:13.194621 25519 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.194792 25519 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:13.194898 25510 consensus_queue.cc:260] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.195204 25510 ts_tablet_manager.cc:1428] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:13.195152 25516 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.195279 25516 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:13.213195 25516 raft_consensus.cc:482] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:13.213342 25516 raft_consensus.cc:504] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.213801 25516 leader_election.cc:288] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:13.214253 25136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9858fabdff5b46119b92f55c714c0571" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a" is_pre_election: true
I20260810 03:45:13.214313 25434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9858fabdff5b46119b92f55c714c0571" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4f3f40a1b0847f592c206ff2a930f91" is_pre_election: true
I20260810 03:45:13.214422 25136 raft_consensus.cc:2454] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 0.
I20260810 03:45:13.214473 25434 raft_consensus.cc:2454] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 0.
I20260810 03:45:13.214736 25217 leader_election.cc:302] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, 65e4b0f555204ffda7e6723d947b4d3a; no voters:
I20260810 03:45:13.214977 25516 raft_consensus.cc:2781] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:13.215063 25516 raft_consensus.cc:482] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:13.215104 25516 raft_consensus.cc:3037] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:13.216277 25516 raft_consensus.cc:504] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.216653 25516 leader_election.cc:288] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 election: Requested vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:13.216993 25136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9858fabdff5b46119b92f55c714c0571" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a"
I20260810 03:45:13.217130 25136 raft_consensus.cc:3037] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:13.217141 25434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9858fabdff5b46119b92f55c714c0571" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4f3f40a1b0847f592c206ff2a930f91"
I20260810 03:45:13.217288 25434 raft_consensus.cc:3037] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:13.218235 25434 raft_consensus.cc:2454] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 1.
I20260810 03:45:13.218248 25136 raft_consensus.cc:2454] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 1.
I20260810 03:45:13.218528 25217 leader_election.cc:302] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, 65e4b0f555204ffda7e6723d947b4d3a; no voters:
I20260810 03:45:13.218727 25516 raft_consensus.cc:2781] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:13.218832 25516 raft_consensus.cc:686] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [term 1 LEADER]: Becoming Leader. State: Replica: 52b715f9796d4d339ec567e93ae7457a, State: Running, Role: LEADER
I20260810 03:45:13.218972 25516 consensus_queue.cc:237] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.219625 25521 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: TxnStatusTablet state changed. Reason: New leader 52b715f9796d4d339ec567e93ae7457a. Latest consensus state: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.219749 25521 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:13.220304 25533 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 03:45:13.220543 25533 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 03:45:13.220829 24961 catalog_manager.cc:5495] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a reported cstate change: term changed from 0 to 1, leader changed from <none> to 52b715f9796d4d339ec567e93ae7457a (127.22.134.194). New cstate: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } health_report { overall_health: UNKNOWN } } }
I20260810 03:45:13.240825 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.236891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32771 (local address 127.0.0.1:51900)
0810 03:45:13.237128 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:13.237147 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:13.237288 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:13.237639 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:13.237641 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:13.237650 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:13.237770 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.237776 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.238508 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.238512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.239162 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.239171 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.239645 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.239649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.239749 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.239804 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:13.240478 (+ 674us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:13.240494 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 03:45:13.240562 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 03:45:13.240656 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:45:13.240825 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.236987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.22.134.194:32771)
0810 03:45:13.237107 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:13.237112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:13.237221 (+ 109us) server_negotiation.cc:407] Connection header received
0810 03:45:13.237435 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:13.237439 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:13.237500 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:13.237625 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:13.237887 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.238392 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.239286 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.239513 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.239640 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.239956 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:13.240379 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:13.240503 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:13.240588 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 03:45:13.240655 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:45:13.246541 25434 raft_consensus.cc:1261] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Refusing update from remote peer 52b715f9796d4d339ec567e93ae7457a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:13.246575 25136 raft_consensus.cc:1261] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Refusing update from remote peer 52b715f9796d4d339ec567e93ae7457a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:13.247272 25521 consensus_queue.cc:1035] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:13.247469 25516 consensus_queue.cc:1035] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:13.252354 25518 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: TxnStatusTablet state changed. Reason: New leader 52b715f9796d4d339ec567e93ae7457a. Latest consensus state: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.252504 25518 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:13.255307 25519 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: TxnStatusTablet state changed. Reason: New leader 52b715f9796d4d339ec567e93ae7457a. Latest consensus state: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.255451 25519 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:13.255393 25516 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.255494 25516 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:13.256043 25536 mvcc.cc:205] Tried to move back new op lower bound from 7316822070251094016 to 7316822070146166784. Current Snapshot: MvccSnapshot[applied={T|T < 7316822070251094016}]
I20260810 03:45:13.256910 25518 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.257035 25518 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P 65e4b0f555204ffda7e6723d947b4d3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:13.259269 25521 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.259397 25521 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P 52b715f9796d4d339ec567e93ae7457a: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:13.260440 25519 tablet_replica.cc:439] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } } }
I20260810 03:45:13.260577 25519 tablet_replica.cc:442] T 9858fabdff5b46119b92f55c714c0571 P d4f3f40a1b0847f592c206ff2a930f91: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:13.264026 25538 mvcc.cc:205] Tried to move back new op lower bound from 7316822070251094016 to 7316822070146166784. Current Snapshot: MvccSnapshot[applied={T|T < 7316822070251094016}]
I20260810 03:45:13.267298 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.263783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51908 (local address 127.22.134.194:32771)
0810 03:45:13.263887 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:13.263892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:13.263936 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:45:13.264102 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:13.264105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:13.264164 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:13.264253 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:13.264498 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.265120 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.266071 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.266292 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.266399 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.266664 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:13.266733 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:13.266808 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:13.267145 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 03:45:13.267193 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 03:45:13.279206 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.275432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:42573 (local address 127.22.134.194:32771)
0810 03:45:13.275618 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:13.275622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:13.275963 (+ 341us) server_negotiation.cc:407] Connection header received
0810 03:45:13.276170 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:13.276172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:13.276208 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:13.276285 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:13.276562 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.277149 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.278089 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.278304 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.278418 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.278735 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:13.278805 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:13.278874 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:13.278961 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 03:45:13.279012 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":65}
I20260810 03:45:13.279211 25547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:13.275395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32771 (local address 127.22.134.194:42573)
0810 03:45:13.275859 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:13.275873 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:13.276017 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:13.276291 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:13.276294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:13.276300 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:13.276458 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.276469 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.277251 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.277256 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.277973 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:13.277982 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:13.278421 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:13.278425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:13.278520 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:13.278565 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:13.278889 (+ 324us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:13.278896 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:45:13.278954 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 03:45:13.279027 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":37,"thread_start_us":258,"threads_started":1}
I20260810 03:45:13.286777 25136 raft_consensus.cc:1261] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Refusing update from remote peer 52b715f9796d4d339ec567e93ae7457a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:13.286777 25434 raft_consensus.cc:1261] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Refusing update from remote peer 52b715f9796d4d339ec567e93ae7457a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:13.287257 25516 consensus_queue.cc:1035] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:13.287604 25548 consensus_queue.cc:1035] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:13.296133 25537 mvcc.cc:205] Tried to move back new op lower bound from 7316822070418878464 to 7316822069663653888. Current Snapshot: MvccSnapshot[applied={T|T < 7316822070418878464}]
I20260810 03:45:13.332261 24961 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:13.332458 24961 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:13.335074 24961 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: Sending DeleteTablet for 3 replicas of tablet 1d4dbce1da724e649b264b7c6d1b64ef
I20260810 03:45:13.335906 25414 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d4dbce1da724e649b264b7c6d1b64ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:13 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:47516
I20260810 03:45:13.336113 25112 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d4dbce1da724e649b264b7c6d1b64ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:13 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:44660
I20260810 03:45:13.336522 24963 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58594:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 03:45:13.336817 25266 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d4dbce1da724e649b264b7c6d1b64ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:13 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:51886
W20260810 03:45:13.337018 24963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:13.337200 25555 tablet_replica.cc:330] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: stopping tablet replica
I20260810 03:45:13.337474 25554 tablet_replica.cc:330] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: stopping tablet replica
I20260810 03:45:13.337744 25555 raft_consensus.cc:2229] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:13.337783 25554 raft_consensus.cc:2229] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:13.338011 25554 raft_consensus.cc:2258] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:13.338053 25555 raft_consensus.cc:2258] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:13.339601 25555 ts_tablet_manager.cc:1905] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:13.339618 25554 ts_tablet_manager.cc:1905] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:13.343094 25554 ts_tablet_manager.cc:1918] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:13.343103 25555 ts_tablet_manager.cc:1918] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:13.343216 25554 log.cc:1196] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/1d4dbce1da724e649b264b7c6d1b64ef
I20260810 03:45:13.343353 25555 log.cc:1196] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/1d4dbce1da724e649b264b7c6d1b64ef
I20260810 03:45:13.343367 25266 tablet_service.cc:1467] Processing CreateTablet for tablet f2487a3fced940a4a09a8be97f434ddc (DEFAULT_TABLE table=test-table [id=d12044a165e143c3967859ce0a3107d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:13.343564 25554 ts_tablet_manager.cc:1939] T 1d4dbce1da724e649b264b7c6d1b64ef P d4f3f40a1b0847f592c206ff2a930f91: Deleting consensus metadata
I20260810 03:45:13.343732 25266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2487a3fced940a4a09a8be97f434ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:13.343927 25555 ts_tablet_manager.cc:1939] T 1d4dbce1da724e649b264b7c6d1b64ef P 65e4b0f555204ffda7e6723d947b4d3a: Deleting consensus metadata
I20260810 03:45:13.344967 25556 tablet_replica.cc:330] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: stopping tablet replica
I20260810 03:45:13.345330 25556 raft_consensus.cc:2229] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:13.345679 25556 raft_consensus.cc:2258] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:13.346212 25414 tablet_service.cc:1467] Processing CreateTablet for tablet f2487a3fced940a4a09a8be97f434ddc (DEFAULT_TABLE table=test-table [id=d12044a165e143c3967859ce0a3107d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:13.346319 25510 tablet_bootstrap.cc:492] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: Bootstrap starting.
I20260810 03:45:13.346477 25414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2487a3fced940a4a09a8be97f434ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:13.347241 25556 ts_tablet_manager.cc:1905] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:13.347410 25510 tablet_bootstrap.cc:654] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:13.348989 24948 catalog_manager.cc:4841] TS 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237): tablet 1d4dbce1da724e649b264b7c6d1b64ef (table test-table [id=587ec20709e04085b17fa8c2cd04d931]) successfully deleted
I20260810 03:45:13.349066 24950 catalog_manager.cc:4841] TS d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143): tablet 1d4dbce1da724e649b264b7c6d1b64ef (table test-table [id=587ec20709e04085b17fa8c2cd04d931]) successfully deleted
I20260810 03:45:13.343114 25112 tablet_service.cc:1467] Processing CreateTablet for tablet f2487a3fced940a4a09a8be97f434ddc (DEFAULT_TABLE table=test-table [id=d12044a165e143c3967859ce0a3107d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:13.349463 25112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2487a3fced940a4a09a8be97f434ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:13.349946 25510 tablet_bootstrap.cc:492] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: No bootstrap required, opened a new log
I20260810 03:45:13.350036 25510 ts_tablet_manager.cc:1397] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260810 03:45:13.350528 25556 ts_tablet_manager.cc:1918] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:13.350479 25510 raft_consensus.cc:348] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.350733 25510 raft_consensus.cc:374] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:13.350778 25556 log.cc:1196] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/1d4dbce1da724e649b264b7c6d1b64ef
I20260810 03:45:13.350788 25510 raft_consensus.cc:729] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b715f9796d4d339ec567e93ae7457a, State: Initialized, Role: FOLLOWER
I20260810 03:45:13.351058 25510 consensus_queue.cc:260] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.351332 25510 ts_tablet_manager.cc:1428] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:13.351951 25556 ts_tablet_manager.cc:1939] T 1d4dbce1da724e649b264b7c6d1b64ef P 52b715f9796d4d339ec567e93ae7457a: Deleting consensus metadata
I20260810 03:45:13.352239 25511 tablet_bootstrap.cc:492] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: Bootstrap starting.
I20260810 03:45:13.353250 25511 tablet_bootstrap.cc:654] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:13.353323 24948 catalog_manager.cc:4841] TS 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771): tablet 1d4dbce1da724e649b264b7c6d1b64ef (table test-table [id=587ec20709e04085b17fa8c2cd04d931]) successfully deleted
I20260810 03:45:13.354496 25511 tablet_bootstrap.cc:492] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: No bootstrap required, opened a new log
I20260810 03:45:13.354583 25511 ts_tablet_manager.cc:1397] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:13.355067 25511 raft_consensus.cc:348] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.355186 25511 raft_consensus.cc:374] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:13.355221 25511 raft_consensus.cc:729] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e4b0f555204ffda7e6723d947b4d3a, State: Initialized, Role: FOLLOWER
I20260810 03:45:13.355363 25511 consensus_queue.cc:260] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.355659 25511 ts_tablet_manager.cc:1428] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:13.356159 25512 tablet_bootstrap.cc:492] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: Bootstrap starting.
I20260810 03:45:13.357261 25512 tablet_bootstrap.cc:654] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:13.357420 25548 raft_consensus.cc:482] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:13.357508 25548 raft_consensus.cc:504] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.357909 25548 leader_election.cc:288] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:13.358265 25135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2487a3fced940a4a09a8be97f434ddc" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a" is_pre_election: true
I20260810 03:45:13.358405 25135 raft_consensus.cc:2454] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 0.
I20260810 03:45:13.358654 25435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2487a3fced940a4a09a8be97f434ddc" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4f3f40a1b0847f592c206ff2a930f91" is_pre_election: true
I20260810 03:45:13.358724 25217 leader_election.cc:302] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, 65e4b0f555204ffda7e6723d947b4d3a; no voters:
I20260810 03:45:13.358889 25548 raft_consensus.cc:2781] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:13.358939 25548 raft_consensus.cc:482] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:13.358979 25548 raft_consensus.cc:3037] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Advancing to term 1
W20260810 03:45:13.359223 25219 leader_election.cc:341] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143): Illegal state: must be running to vote when last-logged opid is not known
I20260810 03:45:13.360548 25548 raft_consensus.cc:504] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.360934 25548 leader_election.cc:288] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 election: Requested vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:13.361344 25135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2487a3fced940a4a09a8be97f434ddc" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a"
I20260810 03:45:13.361462 25135 raft_consensus.cc:3037] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:13.361611 25512 tablet_bootstrap.cc:492] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: No bootstrap required, opened a new log
I20260810 03:45:13.361583 25435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2487a3fced940a4a09a8be97f434ddc" candidate_uuid: "52b715f9796d4d339ec567e93ae7457a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4f3f40a1b0847f592c206ff2a930f91"
I20260810 03:45:13.361702 25512 ts_tablet_manager.cc:1397] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
W20260810 03:45:13.361933 25219 leader_election.cc:341] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143): Illegal state: must be running to vote when last-logged opid is not known
I20260810 03:45:13.362200 25512 raft_consensus.cc:348] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.362313 25512 raft_consensus.cc:374] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:13.362347 25512 raft_consensus.cc:729] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f3f40a1b0847f592c206ff2a930f91, State: Initialized, Role: FOLLOWER
I20260810 03:45:13.362478 25512 consensus_queue.cc:260] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.362581 25135 raft_consensus.cc:2454] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52b715f9796d4d339ec567e93ae7457a in term 1.
I20260810 03:45:13.362890 25217 leader_election.cc:302] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, 65e4b0f555204ffda7e6723d947b4d3a; no voters: d4f3f40a1b0847f592c206ff2a930f91
I20260810 03:45:13.363102 25548 raft_consensus.cc:2781] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:13.363221 25548 raft_consensus.cc:686] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 1 LEADER]: Becoming Leader. State: Replica: 52b715f9796d4d339ec567e93ae7457a, State: Running, Role: LEADER
I20260810 03:45:13.363344 25548 consensus_queue.cc:237] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:13.364986 25512 ts_tablet_manager.cc:1428] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 03:45:13.366523 24961 catalog_manager.cc:5495] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a reported cstate change: term changed from 0 to 1, leader changed from <none> to 52b715f9796d4d339ec567e93ae7457a (127.22.134.194). New cstate: current_term: 1 leader_uuid: "52b715f9796d4d339ec567e93ae7457a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } health_report { overall_health: UNKNOWN } } }
I20260810 03:45:13.388929 25136 raft_consensus.cc:1261] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Refusing update from remote peer 52b715f9796d4d339ec567e93ae7457a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:13.389492 25435 raft_consensus.cc:3037] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:13.389492 25548 consensus_queue.cc:1035] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:13.391081 25435 raft_consensus.cc:1261] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Refusing update from remote peer 52b715f9796d4d339ec567e93ae7457a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:13.395380 25521 consensus_queue.cc:1035] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:45:13.408776 25536 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 03:45:14.963241 24961 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:14.963410 24961 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:14.965968 24961 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: Sending DeleteTablet for 3 replicas of tablet f2487a3fced940a4a09a8be97f434ddc
I20260810 03:45:14.966648 25112 tablet_service.cc:1514] Processing DeleteTablet for tablet f2487a3fced940a4a09a8be97f434ddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:14 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:44660
I20260810 03:45:14.966720 25267 tablet_service.cc:1514] Processing DeleteTablet for tablet f2487a3fced940a4a09a8be97f434ddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:14 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:51886
I20260810 03:45:14.966789 25414 tablet_service.cc:1514] Processing DeleteTablet for tablet f2487a3fced940a4a09a8be97f434ddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:14 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:47516
I20260810 03:45:14.967067 25586 tablet_replica.cc:330] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: stopping tablet replica
I20260810 03:45:14.967233 25588 tablet_replica.cc:330] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: stopping tablet replica
I20260810 03:45:14.967226 25586 raft_consensus.cc:2229] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:14.967388 25586 raft_consensus.cc:2258] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:14.967378 25588 raft_consensus.cc:2229] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:14.967600 25588 raft_consensus.cc:2258] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:14.968209 25586 ts_tablet_manager.cc:1905] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:14.968212 25588 ts_tablet_manager.cc:1905] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:14.968945 25587 tablet_replica.cc:330] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: stopping tablet replica
I20260810 03:45:14.969168 25587 raft_consensus.cc:2229] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:14.969367 25587 raft_consensus.cc:2258] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:14.970309 25587 ts_tablet_manager.cc:1905] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:14.971290 25586 ts_tablet_manager.cc:1918] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:45:14.971290 25588 ts_tablet_manager.cc:1918] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:45:14.971387 25588 log.cc:1196] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/f2487a3fced940a4a09a8be97f434ddc
I20260810 03:45:14.971387 25586 log.cc:1196] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/f2487a3fced940a4a09a8be97f434ddc
I20260810 03:45:14.971735 25586 ts_tablet_manager.cc:1939] T f2487a3fced940a4a09a8be97f434ddc P 65e4b0f555204ffda7e6723d947b4d3a: Deleting consensus metadata
I20260810 03:45:14.971755 25588 ts_tablet_manager.cc:1939] T f2487a3fced940a4a09a8be97f434ddc P 52b715f9796d4d339ec567e93ae7457a: Deleting consensus metadata
I20260810 03:45:14.972493 24948 catalog_manager.cc:4841] TS 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237): tablet f2487a3fced940a4a09a8be97f434ddc (table test-table [id=d12044a165e143c3967859ce0a3107d5]) successfully deleted
I20260810 03:45:14.972770 24948 catalog_manager.cc:4841] TS 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771): tablet f2487a3fced940a4a09a8be97f434ddc (table test-table [id=d12044a165e143c3967859ce0a3107d5]) successfully deleted
I20260810 03:45:14.973831 25587 ts_tablet_manager.cc:1918] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:45:14.973932 25587 log.cc:1196] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/f2487a3fced940a4a09a8be97f434ddc
I20260810 03:45:14.974223 25587 ts_tablet_manager.cc:1939] T f2487a3fced940a4a09a8be97f434ddc P d4f3f40a1b0847f592c206ff2a930f91: Deleting consensus metadata
I20260810 03:45:14.975104 24950 catalog_manager.cc:4841] TS d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143): tablet f2487a3fced940a4a09a8be97f434ddc (table test-table [id=d12044a165e143c3967859ce0a3107d5]) successfully deleted
Aug 10 03:45:14 dist-test-slave-qg60 krb5kdc[24913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333514, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:45:14 dist-test-slave-qg60 krb5kdc[24913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333514, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:14.999048 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:14.989587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53634 (local address 127.22.134.254:41329)
0810 03:45:14.989891 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:14.989898 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:14.989913 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:45:14.989959 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:14.989961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:14.990002 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:14.990085 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:14.990847 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:14.991393 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:14.992292 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:14.992516 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:14.992620 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:14.995571 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:14.995573 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:14.995576 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:14.995626 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:14.997286 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:14.997733 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:14.997738 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:14.997740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:14.997827 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:14.998104 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:14.998111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:14.998113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:14.998315 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:14.998456 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:14.998707 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 03:45:14.998843 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":114,"threads_started":1}
I20260810 03:45:15.002106 24961 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53634:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:15.002645 24961 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:15.007663 25267 tablet_service.cc:1467] Processing CreateTablet for tablet 3f79d9bc9f4a4607b6af764e5a282170 (DEFAULT_TABLE table=test-table [id=4a7aaa03565c4e2d9b82f804abd0ad8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:15.007664 25112 tablet_service.cc:1467] Processing CreateTablet for tablet 3f79d9bc9f4a4607b6af764e5a282170 (DEFAULT_TABLE table=test-table [id=4a7aaa03565c4e2d9b82f804abd0ad8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:15.007737 25414 tablet_service.cc:1467] Processing CreateTablet for tablet 3f79d9bc9f4a4607b6af764e5a282170 (DEFAULT_TABLE table=test-table [id=4a7aaa03565c4e2d9b82f804abd0ad8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:15.008002 25267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f79d9bc9f4a4607b6af764e5a282170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:15.008002 25414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f79d9bc9f4a4607b6af764e5a282170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:15.008004 25112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f79d9bc9f4a4607b6af764e5a282170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:15.010545 25597 tablet_bootstrap.cc:492] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: Bootstrap starting.
I20260810 03:45:15.010703 25598 tablet_bootstrap.cc:492] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: Bootstrap starting.
I20260810 03:45:15.011668 25597 tablet_bootstrap.cc:654] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:15.011696 25598 tablet_bootstrap.cc:654] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:15.012919 25599 tablet_bootstrap.cc:492] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: Bootstrap starting.
I20260810 03:45:15.013036 25597 tablet_bootstrap.cc:492] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: No bootstrap required, opened a new log
I20260810 03:45:15.013144 25597 ts_tablet_manager.cc:1397] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:15.013449 25598 tablet_bootstrap.cc:492] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: No bootstrap required, opened a new log
I20260810 03:45:15.013542 25598 ts_tablet_manager.cc:1397] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:15.013549 25597 raft_consensus.cc:348] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.013700 25597 raft_consensus.cc:374] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:15.013741 25597 raft_consensus.cc:729] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b715f9796d4d339ec567e93ae7457a, State: Initialized, Role: FOLLOWER
I20260810 03:45:15.013886 25597 consensus_queue.cc:260] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.013998 25599 tablet_bootstrap.cc:654] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:15.014094 25598 raft_consensus.cc:348] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.014238 25598 raft_consensus.cc:374] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:15.014278 25598 raft_consensus.cc:729] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e4b0f555204ffda7e6723d947b4d3a, State: Initialized, Role: FOLLOWER
I20260810 03:45:15.014294 25597 ts_tablet_manager.cc:1428] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:15.014426 25598 consensus_queue.cc:260] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.014851 25598 ts_tablet_manager.cc:1428] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260810 03:45:15.015658 25599 tablet_bootstrap.cc:492] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: No bootstrap required, opened a new log
I20260810 03:45:15.015750 25599 ts_tablet_manager.cc:1397] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:15.016259 25599 raft_consensus.cc:348] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.016431 25599 raft_consensus.cc:374] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:15.016485 25599 raft_consensus.cc:729] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f3f40a1b0847f592c206ff2a930f91, State: Initialized, Role: FOLLOWER
I20260810 03:45:15.016634 25599 consensus_queue.cc:260] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.017091 25599 ts_tablet_manager.cc:1428] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260810 03:45:15.246795 25602 raft_consensus.cc:482] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:15.246942 25602 raft_consensus.cc:504] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.247486 25604 raft_consensus.cc:482] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:15.247623 25604 raft_consensus.cc:504] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.248301 25602 leader_election.cc:288] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771), d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:15.249310 25604 leader_election.cc:288] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771)
I20260810 03:45:15.253890 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.248504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32771 (local address 127.22.134.193:51179)
0810 03:45:15.249014 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:15.249031 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:15.249141 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:15.249609 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:15.249612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:15.249630 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:15.249759 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.249768 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.250871 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.250875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.252286 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.252296 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.253398 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.253402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.253505 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.253544 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 03:45:15.253630 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 03:45:15.253712 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":4,"thread_start_us":174,"threads_started":1}
I20260810 03:45:15.254437 25607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.248649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:51179 (local address 127.22.134.194:32771)
0810 03:45:15.249126 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.249136 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.249154 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:45:15.249311 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.249315 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.249373 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.249457 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:15.249909 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.250744 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.252426 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.253154 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.253264 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.253316 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.254199 (+ 883us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.254294 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":184,"threads_started":1}
I20260810 03:45:15.254439 25606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.248665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:50509 (local address 127.22.134.195:40143)
0810 03:45:15.249911 (+ 1246us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.249921 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.249938 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:45:15.249985 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.249988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.250031 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.250125 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:15.250402 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.251160 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.252543 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.253465 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.253593 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.253638 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.254202 (+ 564us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.254289 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":150,"server-negotiator.queue_time_us":1173,"thread_start_us":139,"threads_started":1}
I20260810 03:45:15.254113 25608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.248508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:40143 (local address 127.22.134.193:50509)
0810 03:45:15.249500 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:15.249513 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:15.249600 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:15.250149 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:15.250152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:15.250172 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:15.250283 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.250289 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.251284 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.251287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.252424 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.252432 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.253699 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.253703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.253803 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.253826 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:45:15.253892 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 03:45:15.253956 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":360,"thread_start_us":97,"threads_started":1}
I20260810 03:45:15.254904 25609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.248919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:33237 (local address 127.22.134.195:53067)
0810 03:45:15.249214 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:15.249228 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:15.249316 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:15.250170 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:15.250173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:15.250186 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:15.250370 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.250379 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.251857 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.251861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.253473 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.253485 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.254375 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.254379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.254580 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.254614 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 03:45:15.254676 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 03:45:15.254748 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":208,"thread_start_us":103,"threads_started":1}
I20260810 03:45:15.255069 25435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f79d9bc9f4a4607b6af764e5a282170" candidate_uuid: "65e4b0f555204ffda7e6723d947b4d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4f3f40a1b0847f592c206ff2a930f91" is_pre_election: true
I20260810 03:45:15.255229 25435 raft_consensus.cc:2454] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e4b0f555204ffda7e6723d947b4d3a in term 0.
I20260810 03:45:15.255223 25286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f79d9bc9f4a4607b6af764e5a282170" candidate_uuid: "65e4b0f555204ffda7e6723d947b4d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52b715f9796d4d339ec567e93ae7457a" is_pre_election: true
I20260810 03:45:15.255455 25286 raft_consensus.cc:2454] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e4b0f555204ffda7e6723d947b4d3a in term 0.
I20260810 03:45:15.255540 25610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.249272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:53067 (local address 127.22.134.193:33237)
0810 03:45:15.249929 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.249939 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.249952 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:15.249989 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.249991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.250031 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.250485 (+ 454us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:15.250654 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.251724 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.253621 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.254239 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.255195 (+ 956us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.255256 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.255294 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.255363 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":595,"thread_start_us":90,"threads_started":1}
I20260810 03:45:15.255642 25063 leader_election.cc:302] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e4b0f555204ffda7e6723d947b4d3a, d4f3f40a1b0847f592c206ff2a930f91; no voters:
I20260810 03:45:15.255973 25602 raft_consensus.cc:2781] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:15.256048 25602 raft_consensus.cc:482] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:15.256093 25602 raft_consensus.cc:3037] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:15.256124 25611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.249617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32771 (local address 127.22.134.195:44759)
0810 03:45:15.249905 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:15.249918 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:15.250001 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:15.250692 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:15.250695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:15.250738 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:15.250857 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.250864 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.251916 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.251919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.253481 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.253490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.254401 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.254404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.255783 (+ 1379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.255809 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:45:15.255879 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 03:45:15.255955 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":201,"thread_start_us":91,"threads_started":1}
I20260810 03:45:15.256335 25136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f79d9bc9f4a4607b6af764e5a282170" candidate_uuid: "d4f3f40a1b0847f592c206ff2a930f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a" is_pre_election: true
I20260810 03:45:15.256410 25612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.249698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:44759 (local address 127.22.134.194:32771)
0810 03:45:15.250355 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.250364 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.250377 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:15.250420 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.250425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.250479 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.250588 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:15.250993 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.251784 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.253604 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.254193 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.254304 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.254346 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.255937 (+ 1591us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.256021 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":81,"threads_started":1}
I20260810 03:45:15.256836 25286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f79d9bc9f4a4607b6af764e5a282170" candidate_uuid: "d4f3f40a1b0847f592c206ff2a930f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52b715f9796d4d339ec567e93ae7457a" is_pre_election: true
I20260810 03:45:15.256963 25286 raft_consensus.cc:2454] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4f3f40a1b0847f592c206ff2a930f91 in term 0.
I20260810 03:45:15.257341 25364 leader_election.cc:302] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, d4f3f40a1b0847f592c206ff2a930f91; no voters:
I20260810 03:45:15.257501 25602 raft_consensus.cc:504] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.257593 25604 raft_consensus.cc:2781] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:15.257645 25604 raft_consensus.cc:482] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:15.257697 25604 raft_consensus.cc:3037] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:15.257921 25602 leader_election.cc:288] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [CANDIDATE]: Term 1 election: Requested vote from peers 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771), d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143)
I20260810 03:45:15.258098 25136 raft_consensus.cc:2379] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4f3f40a1b0847f592c206ff2a930f91 in current term 1: Already voted for candidate 65e4b0f555204ffda7e6723d947b4d3a in this term.
I20260810 03:45:15.258195 25286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f79d9bc9f4a4607b6af764e5a282170" candidate_uuid: "65e4b0f555204ffda7e6723d947b4d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52b715f9796d4d339ec567e93ae7457a"
I20260810 03:45:15.258324 25286 raft_consensus.cc:3037] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:15.258845 25435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f79d9bc9f4a4607b6af764e5a282170" candidate_uuid: "65e4b0f555204ffda7e6723d947b4d3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4f3f40a1b0847f592c206ff2a930f91"
I20260810 03:45:15.258997 25604 raft_consensus.cc:504] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.259341 25604 leader_election.cc:288] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [CANDIDATE]: Term 1 election: Requested vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771)
I20260810 03:45:15.259722 25286 raft_consensus.cc:2454] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e4b0f555204ffda7e6723d947b4d3a in term 1.
I20260810 03:45:15.259790 25435 raft_consensus.cc:2379] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65e4b0f555204ffda7e6723d947b4d3a in current term 1: Already voted for candidate d4f3f40a1b0847f592c206ff2a930f91 in this term.
I20260810 03:45:15.259934 25286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f79d9bc9f4a4607b6af764e5a282170" candidate_uuid: "d4f3f40a1b0847f592c206ff2a930f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52b715f9796d4d339ec567e93ae7457a"
I20260810 03:45:15.260043 25136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f79d9bc9f4a4607b6af764e5a282170" candidate_uuid: "d4f3f40a1b0847f592c206ff2a930f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a"
I20260810 03:45:15.260107 25286 raft_consensus.cc:2379] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d4f3f40a1b0847f592c206ff2a930f91 in current term 1: Already voted for candidate 65e4b0f555204ffda7e6723d947b4d3a in this term.
I20260810 03:45:15.260147 25060 leader_election.cc:302] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, 65e4b0f555204ffda7e6723d947b4d3a; no voters:
I20260810 03:45:15.260192 25136 raft_consensus.cc:2379] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d4f3f40a1b0847f592c206ff2a930f91 in current term 1: Already voted for candidate 65e4b0f555204ffda7e6723d947b4d3a in this term.
I20260810 03:45:15.260320 25602 raft_consensus.cc:2781] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:15.260560 25602 raft_consensus.cc:686] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 LEADER]: Becoming Leader. State: Replica: 65e4b0f555204ffda7e6723d947b4d3a, State: Running, Role: LEADER
I20260810 03:45:15.260849 25602 consensus_queue.cc:237] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.261931 25364 leader_election.cc:302] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4f3f40a1b0847f592c206ff2a930f91; no voters: 52b715f9796d4d339ec567e93ae7457a, 65e4b0f555204ffda7e6723d947b4d3a
I20260810 03:45:15.262174 25604 raft_consensus.cc:2726] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 03:45:15.263209 24963 catalog_manager.cc:5495] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193). New cstate: current_term: 1 leader_uuid: "65e4b0f555204ffda7e6723d947b4d3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } health_report { overall_health: UNKNOWN } } }
I20260810 03:45:15.317699 25610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.313819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40872 (local address 127.22.134.193:33237)
0810 03:45:15.313942 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.313946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.313973 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:45:15.314162 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.314165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.314220 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.314312 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:15.314541 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.315085 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.316133 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.316372 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.316484 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.316793 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.317293 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.317427 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.317485 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.317542 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:45:15.328830 25612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.325191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:48573 (local address 127.22.134.194:32771)
0810 03:45:15.325358 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.325363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.325529 (+ 166us) server_negotiation.cc:407] Connection header received
0810 03:45:15.325699 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.325702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.325757 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.325839 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:15.326095 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.326752 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.327699 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.327922 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.328035 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.328340 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.328417 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.328496 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.328591 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.328645 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:45:15.328843 25619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.325092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32771 (local address 127.22.134.193:48573)
0810 03:45:15.325435 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:15.325449 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:15.325579 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:15.325851 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:15.325855 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:15.325863 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:15.325987 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.325992 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.326883 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.326890 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.327574 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.327583 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.328066 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.328072 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.328158 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.328201 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.328509 (+ 308us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.328518 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 03:45:15.328582 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 03:45:15.328664 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":114,"threads_started":1}
I20260810 03:45:15.335253 25435 raft_consensus.cc:1261] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Refusing update from remote peer 65e4b0f555204ffda7e6723d947b4d3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:15.335465 25286 raft_consensus.cc:1261] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Refusing update from remote peer 65e4b0f555204ffda7e6723d947b4d3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:15.335707 25602 consensus_queue.cc:1035] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:15.336067 25613 consensus_queue.cc:1035] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:15.354522 25610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.351141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:47885 (local address 127.22.134.193:33237)
0810 03:45:15.351271 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.351275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.351288 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:15.351394 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.351397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.351441 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.351522 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:15.351784 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.352359 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.353491 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.353851 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.353935 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.354169 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.354236 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.354293 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.354370 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.354415 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:45:15.354537 25623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.350865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:33237 (local address 127.22.134.194:47885)
0810 03:45:15.351160 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:15.351194 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:15.351296 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:15.351532 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:15.351536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:15.351544 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:15.351663 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.351669 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.352461 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.352466 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.353352 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.353360 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.353960 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.353962 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.354024 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.354052 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.354307 (+ 255us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.354312 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:45:15.354357 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 03:45:15.354422 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":146,"threads_started":1}
I20260810 03:45:15.376474 24963 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:15.376693 24963 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:15.378829 24963 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: Sending DeleteTablet for 3 replicas of tablet 3f79d9bc9f4a4607b6af764e5a282170
I20260810 03:45:15.379531 25267 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f79d9bc9f4a4607b6af764e5a282170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:15 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:51886
I20260810 03:45:15.379673 25414 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f79d9bc9f4a4607b6af764e5a282170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:15 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:47516
I20260810 03:45:15.379778 25588 tablet_replica.cc:330] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: stopping tablet replica
I20260810 03:45:15.379853 25587 tablet_replica.cc:330] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: stopping tablet replica
I20260810 03:45:15.379904 25588 raft_consensus.cc:2229] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:15.379953 25587 raft_consensus.cc:2229] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:15.380023 25588 raft_consensus.cc:2258] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:15.380059 25587 raft_consensus.cc:2258] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:15.380872 25588 ts_tablet_manager.cc:1905] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:15.380872 25587 ts_tablet_manager.cc:1905] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:15.383728 25587 ts_tablet_manager.cc:1918] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:15.383821 25587 log.cc:1196] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/3f79d9bc9f4a4607b6af764e5a282170
I20260810 03:45:15.383826 25588 ts_tablet_manager.cc:1918] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:15.383896 25588 log.cc:1196] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/3f79d9bc9f4a4607b6af764e5a282170
I20260810 03:45:15.384130 25587 ts_tablet_manager.cc:1939] T 3f79d9bc9f4a4607b6af764e5a282170 P d4f3f40a1b0847f592c206ff2a930f91: Deleting consensus metadata
I20260810 03:45:15.384171 25588 ts_tablet_manager.cc:1939] T 3f79d9bc9f4a4607b6af764e5a282170 P 52b715f9796d4d339ec567e93ae7457a: Deleting consensus metadata
I20260810 03:45:15.384629 25112 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f79d9bc9f4a4607b6af764e5a282170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:15 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:44660
I20260810 03:45:15.384850 25586 tablet_replica.cc:330] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: stopping tablet replica
I20260810 03:45:15.384971 25586 raft_consensus.cc:2229] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:15.384976 24950 catalog_manager.cc:4841] TS d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143): tablet 3f79d9bc9f4a4607b6af764e5a282170 (table test-table [id=4a7aaa03565c4e2d9b82f804abd0ad8f]) successfully deleted
I20260810 03:45:15.385275 25586 raft_consensus.cc:2258] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:15.385375 24963 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53634:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:15.385854 24963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:15.386111 25586 ts_tablet_manager.cc:1905] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:15.388473 25586 ts_tablet_manager.cc:1918] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:15.388567 25586 log.cc:1196] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/3f79d9bc9f4a4607b6af764e5a282170
I20260810 03:45:15.388875 25586 ts_tablet_manager.cc:1939] T 3f79d9bc9f4a4607b6af764e5a282170 P 65e4b0f555204ffda7e6723d947b4d3a: Deleting consensus metadata
I20260810 03:45:15.390247 24948 catalog_manager.cc:4841] TS 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237): tablet 3f79d9bc9f4a4607b6af764e5a282170 (table test-table [id=4a7aaa03565c4e2d9b82f804abd0ad8f]) successfully deleted
I20260810 03:45:15.391427 24948 catalog_manager.cc:4841] TS 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771): tablet 3f79d9bc9f4a4607b6af764e5a282170 (table test-table [id=4a7aaa03565c4e2d9b82f804abd0ad8f]) successfully deleted
I20260810 03:45:15.394116 25112 tablet_service.cc:1467] Processing CreateTablet for tablet 23249b2964f24fb88837c8b6964b0b4e (DEFAULT_TABLE table=test-table [id=d4ef41d820684fe4acef2ac03fb2ae87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:15.394387 25112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23249b2964f24fb88837c8b6964b0b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:15.396399 25598 tablet_bootstrap.cc:492] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a: Bootstrap starting.
I20260810 03:45:15.397728 25598 tablet_bootstrap.cc:654] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:15.397673 25267 tablet_service.cc:1467] Processing CreateTablet for tablet 23249b2964f24fb88837c8b6964b0b4e (DEFAULT_TABLE table=test-table [id=d4ef41d820684fe4acef2ac03fb2ae87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:15.397982 25267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23249b2964f24fb88837c8b6964b0b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:15.398670 25414 tablet_service.cc:1467] Processing CreateTablet for tablet 23249b2964f24fb88837c8b6964b0b4e (DEFAULT_TABLE table=test-table [id=d4ef41d820684fe4acef2ac03fb2ae87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:15.398919 25414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23249b2964f24fb88837c8b6964b0b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:15.401458 25599 tablet_bootstrap.cc:492] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: Bootstrap starting.
I20260810 03:45:15.401531 25597 tablet_bootstrap.cc:492] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: Bootstrap starting.
I20260810 03:45:15.402587 25597 tablet_bootstrap.cc:654] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:15.402761 25599 tablet_bootstrap.cc:654] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:15.402827 25598 tablet_bootstrap.cc:492] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a: No bootstrap required, opened a new log
I20260810 03:45:15.402912 25598 ts_tablet_manager.cc:1397] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 03:45:15.403403 25598 raft_consensus.cc:348] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.403522 25598 raft_consensus.cc:374] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:15.403560 25598 raft_consensus.cc:729] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e4b0f555204ffda7e6723d947b4d3a, State: Initialized, Role: FOLLOWER
I20260810 03:45:15.403702 25598 consensus_queue.cc:260] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.404000 25598 ts_tablet_manager.cc:1428] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:15.405226 25597 tablet_bootstrap.cc:492] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: No bootstrap required, opened a new log
I20260810 03:45:15.405325 25597 ts_tablet_manager.cc:1397] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 03:45:15.405753 25597 raft_consensus.cc:348] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.405866 25597 raft_consensus.cc:374] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:15.405900 25597 raft_consensus.cc:729] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b715f9796d4d339ec567e93ae7457a, State: Initialized, Role: FOLLOWER
I20260810 03:45:15.406018 25597 consensus_queue.cc:260] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.406306 25597 ts_tablet_manager.cc:1428] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:15.408444 25599 tablet_bootstrap.cc:492] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: No bootstrap required, opened a new log
I20260810 03:45:15.408573 25599 ts_tablet_manager.cc:1397] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260810 03:45:15.409231 25599 raft_consensus.cc:348] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.409348 25599 raft_consensus.cc:374] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:15.409404 25599 raft_consensus.cc:729] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f3f40a1b0847f592c206ff2a930f91, State: Initialized, Role: FOLLOWER
I20260810 03:45:15.409543 25599 consensus_queue.cc:260] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.409817 25599 ts_tablet_manager.cc:1428] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260810 03:45:15.598305 25604 raft_consensus.cc:482] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:15.598466 25604 raft_consensus.cc:504] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.598953 25604 leader_election.cc:288] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771)
I20260810 03:45:15.599431 25136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23249b2964f24fb88837c8b6964b0b4e" candidate_uuid: "d4f3f40a1b0847f592c206ff2a930f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a" is_pre_election: true
I20260810 03:45:15.599586 25136 raft_consensus.cc:2454] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4f3f40a1b0847f592c206ff2a930f91 in term 0.
I20260810 03:45:15.599550 25286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23249b2964f24fb88837c8b6964b0b4e" candidate_uuid: "d4f3f40a1b0847f592c206ff2a930f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52b715f9796d4d339ec567e93ae7457a" is_pre_election: true
I20260810 03:45:15.599761 25286 raft_consensus.cc:2454] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4f3f40a1b0847f592c206ff2a930f91 in term 0.
I20260810 03:45:15.599937 25364 leader_election.cc:302] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e4b0f555204ffda7e6723d947b4d3a, d4f3f40a1b0847f592c206ff2a930f91; no voters:
I20260810 03:45:15.600108 25604 raft_consensus.cc:2781] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:15.600172 25604 raft_consensus.cc:482] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:15.600214 25604 raft_consensus.cc:3037] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:15.601608 25604 raft_consensus.cc:504] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.601984 25604 leader_election.cc:288] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [CANDIDATE]: Term 1 election: Requested vote from peers 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237), 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771)
I20260810 03:45:15.602389 25136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23249b2964f24fb88837c8b6964b0b4e" candidate_uuid: "d4f3f40a1b0847f592c206ff2a930f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e4b0f555204ffda7e6723d947b4d3a"
I20260810 03:45:15.602437 25286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23249b2964f24fb88837c8b6964b0b4e" candidate_uuid: "d4f3f40a1b0847f592c206ff2a930f91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52b715f9796d4d339ec567e93ae7457a"
I20260810 03:45:15.602530 25136 raft_consensus.cc:3037] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:15.602560 25286 raft_consensus.cc:3037] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:15.603819 25286 raft_consensus.cc:2454] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4f3f40a1b0847f592c206ff2a930f91 in term 1.
I20260810 03:45:15.603875 25136 raft_consensus.cc:2454] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4f3f40a1b0847f592c206ff2a930f91 in term 1.
I20260810 03:45:15.604146 25364 leader_election.cc:302] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52b715f9796d4d339ec567e93ae7457a, d4f3f40a1b0847f592c206ff2a930f91; no voters:
I20260810 03:45:15.604316 25604 raft_consensus.cc:2781] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:15.604533 25604 raft_consensus.cc:686] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 1 LEADER]: Becoming Leader. State: Replica: d4f3f40a1b0847f592c206ff2a930f91, State: Running, Role: LEADER
I20260810 03:45:15.604853 25604 consensus_queue.cc:237] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } }
I20260810 03:45:15.607542 24961 catalog_manager.cc:5495] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "d4f3f40a1b0847f592c206ff2a930f91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4f3f40a1b0847f592c206ff2a930f91" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40143 } health_report { overall_health: HEALTHY } } }
I20260810 03:45:15.649477 25606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.645776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39726 (local address 127.22.134.195:40143)
0810 03:45:15.645881 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.645886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.645953 (+ 67us) server_negotiation.cc:407] Connection header received
0810 03:45:15.646240 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.646242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.646298 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.646408 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:15.646635 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.647142 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.647953 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.648176 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.648282 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.648561 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.649079 (+ 518us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.649201 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.649271 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.649328 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 03:45:15.660151 25633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.656650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32771 (local address 127.22.134.195:38481)
0810 03:45:15.657092 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:15.657110 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:15.657218 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:15.657434 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:15.657436 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:15.657442 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:15.657562 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.657566 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.658297 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.658299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.658941 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.658949 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.659462 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.659465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.659552 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.659598 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.659872 (+ 274us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.659876 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 03:45:15.659925 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 03:45:15.659988 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":181,"threads_started":1}
I20260810 03:45:15.660159 25612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.656895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:38481 (local address 127.22.134.194:32771)
0810 03:45:15.657135 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.657139 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.657186 (+ 47us) server_negotiation.cc:407] Connection header received
0810 03:45:15.657305 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.657307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.657350 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.657418 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:15.657648 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.658194 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.659114 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.659354 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.659456 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.659721 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.659797 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.659858 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.659934 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.660046 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260810 03:45:15.666512 25136 raft_consensus.cc:1261] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a [term 1 FOLLOWER]: Refusing update from remote peer d4f3f40a1b0847f592c206ff2a930f91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:15.666527 25286 raft_consensus.cc:1261] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Refusing update from remote peer d4f3f40a1b0847f592c206ff2a930f91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:15.666961 25604 consensus_queue.cc:1035] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e4b0f555204ffda7e6723d947b4d3a" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:15.667230 25629 consensus_queue.cc:1035] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52b715f9796d4d339ec567e93ae7457a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:15.685158 25623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.681767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:40143 (local address 127.22.134.194:40255)
0810 03:45:15.681966 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:15.681982 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:15.682065 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:15.682284 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:15.682288 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:15.682296 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:15.682395 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.682400 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.683159 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.683161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.683920 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:15.683930 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.684408 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.684411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:15.684503 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.684534 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.684855 (+ 321us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.684862 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:45:15.684933 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 03:45:15.685014 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260810 03:45:15.685190 25606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:15.681868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:40255 (local address 127.22.134.195:40143)
0810 03:45:15.682093 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:15.682097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:15.682110 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:15.682147 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:15.682149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:15.682187 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:15.682252 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:15.682484 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.682988 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.684033 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:15.684323 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:15.684404 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:15.684666 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:15.684780 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:15.684853 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:15.684951 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 03:45:15.685011 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260810 03:45:15.685956 25567 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 03:45:17.249238 24962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:17.249400 24962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:17.252245 24962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8ec8a6f82c14d1289df4aa872743119: Sending DeleteTablet for 3 replicas of tablet 23249b2964f24fb88837c8b6964b0b4e
I20260810 03:45:17.252934 25112 tablet_service.cc:1514] Processing DeleteTablet for tablet 23249b2964f24fb88837c8b6964b0b4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:17 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:44660
I20260810 03:45:17.252975 25414 tablet_service.cc:1514] Processing DeleteTablet for tablet 23249b2964f24fb88837c8b6964b0b4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:17 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:47516
I20260810 03:45:17.253005 25267 tablet_service.cc:1514] Processing DeleteTablet for tablet 23249b2964f24fb88837c8b6964b0b4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:17 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:51886
I20260810 03:45:17.253327 25663 tablet_replica.cc:330] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: stopping tablet replica
I20260810 03:45:17.253350 25662 tablet_replica.cc:330] T 23249b2964f24fb88837c8b6964b0b4e P 65e4b0f555204ffda7e6723d947b4d3a: stopping tablet replica
I20260810 03:45:17.253376 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 25042
I20260810 03:45:17.258971 25664 tablet_replica.cc:330] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: stopping tablet replica
I20260810 03:45:17.259163 25664 raft_consensus.cc:2229] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:17.259325 25664 raft_consensus.cc:2258] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:17.260123 25664 ts_tablet_manager.cc:1905] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:17.253471 25663 raft_consensus.cc:2229] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:17.261301 25663 raft_consensus.cc:2258] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:17.262029 25663 ts_tablet_manager.cc:1905] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:17.262806 25664 ts_tablet_manager.cc:1918] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:45:17.262912 25664 log.cc:1196] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/23249b2964f24fb88837c8b6964b0b4e
I20260810 03:45:17.263202 25664 ts_tablet_manager.cc:1939] T 23249b2964f24fb88837c8b6964b0b4e P 52b715f9796d4d339ec567e93ae7457a: Deleting consensus metadata
I20260810 03:45:17.264000 24948 catalog_manager.cc:4841] TS 52b715f9796d4d339ec567e93ae7457a (127.22.134.194:32771): tablet 23249b2964f24fb88837c8b6964b0b4e (table test-table [id=d4ef41d820684fe4acef2ac03fb2ae87]) successfully deleted
I20260810 03:45:17.264876 25663 ts_tablet_manager.cc:1918] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 03:45:17.264974 25663 log.cc:1196] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/23249b2964f24fb88837c8b6964b0b4e
W20260810 03:45:17.265174 24948 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:33237 (error 108)
I20260810 03:45:17.265363 25663 ts_tablet_manager.cc:1939] T 23249b2964f24fb88837c8b6964b0b4e P d4f3f40a1b0847f592c206ff2a930f91: Deleting consensus metadata
I20260810 03:45:17.266242 24950 catalog_manager.cc:4841] TS d4f3f40a1b0847f592c206ff2a930f91 (127.22.134.195:40143): tablet 23249b2964f24fb88837c8b6964b0b4e (table test-table [id=d4ef41d820684fe4acef2ac03fb2ae87]) successfully deleted
I20260810 03:45:17.266561 25666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:17.266040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:33237 (local address 127.0.0.1:40888)
0810 03:45:17.266339 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:17.266434 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:33237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":125,"threads_started":1}
I20260810 03:45:17.266623 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 25199
W20260810 03:45:17.266697 24948 catalog_manager.cc:4584] TS 65e4b0f555204ffda7e6723d947b4d3a (127.22.134.193:33237): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 23249b2964f24fb88837c8b6964b0b4e: Network error: Client connection negotiation failed: client connection to 127.22.134.193:33237: connect: Connection refused (error 111)
I20260810 03:45:17.276903 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 25347
I20260810 03:45:17.286363 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 24928
2026-08-10T03:45:17Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6705 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:17 dist-test-slave-qg60 krb5kdc[25669](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:17 dist-test-slave-qg60 krb5kdc[25669](info): set up 2 sockets
Aug 10 03:45:17 dist-test-slave-qg60 krb5kdc[25669](info): commencing operation
krb5kdc: starting...
W20260810 03:45:18.417892 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:18 dist-test-slave-qg60 krb5kdc[25669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:18.580654 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40143
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:40143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:18.694602 25682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:18.694923 25682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:18.695003 25682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:18.699113 25682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:18.699210 25682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:18.699250 25682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:18.699306 25682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:18.699342 25682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:18.704855 25682 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:40143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:18.706025 25682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:18.707069 25682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:18.716169 25687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:18.716240 25688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:18.716315 25682 server_base.cc:1034] running on GCE node
W20260810 03:45:18.716563 25690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:18.717175 25682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:18.718307 25682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:18.719481 25682 hybrid_clock.cc:648] HybridClock initialized: now 1786333518719451 us; error 43 us; skew 500 ppm
Aug 10 03:45:18 dist-test-slave-qg60 krb5kdc[25669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333518, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:18.722298 25682 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:18.723249 25682 webserver.cc:460] Webserver started at http://127.22.134.254:38775/ using document root <none> and password file <none>
I20260810 03:45:18.723838 25682 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:18.723928 25682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:18.724159 25682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:18.726295 25682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "b98ab390adf84995a330d7dd56768db7"
format_stamp: "Formatted at 2026-08-10 03:45:18 on dist-test-slave-qg60"
server_key: "368b209423cd3b8e50d6cf22531772b9"
server_key_iv: "80b52337576281d7da075fa5aab3142a"
server_key_version: "encryptionkey@0"
I20260810 03:45:18.726873 25682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "b98ab390adf84995a330d7dd56768db7"
format_stamp: "Formatted at 2026-08-10 03:45:18 on dist-test-slave-qg60"
server_key: "368b209423cd3b8e50d6cf22531772b9"
server_key_iv: "80b52337576281d7da075fa5aab3142a"
server_key_version: "encryptionkey@0"
I20260810 03:45:18.730679 25682 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:18.733227 25697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:18.734535 25682 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:18.734699 25682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "b98ab390adf84995a330d7dd56768db7"
format_stamp: "Formatted at 2026-08-10 03:45:18 on dist-test-slave-qg60"
server_key: "368b209423cd3b8e50d6cf22531772b9"
server_key_iv: "80b52337576281d7da075fa5aab3142a"
server_key_version: "encryptionkey@0"
I20260810 03:45:18.734815 25682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:18.758671 25682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:18.761832 25682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:18.762038 25682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:18.769326 25682 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:40143
I20260810 03:45:18.769351 25755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:40143 every 8 connection(s)
I20260810 03:45:18.770292 25682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:18.773299 25756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:18.777930 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 25682
I20260810 03:45:18.778061 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:18.778332 23067 external_mini_cluster.cc:1428] Setting key 1ca10abe09e711a47afce508793d5893
I20260810 03:45:18.779699 25756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7: Bootstrap starting.
I20260810 03:45:18.782176 25756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:18.782953 25756 log.cc:824] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:18.784950 25756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7: No bootstrap required, opened a new log
Aug 10 03:45:18 dist-test-slave-qg60 krb5kdc[25669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:18.789234 25756 raft_consensus.cc:348] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b98ab390adf84995a330d7dd56768db7" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40143 } }
I20260810 03:45:18.789510 25756 raft_consensus.cc:374] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:18.789595 25756 raft_consensus.cc:729] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98ab390adf84995a330d7dd56768db7, State: Initialized, Role: FOLLOWER
I20260810 03:45:18.790094 25756 consensus_queue.cc:260] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b98ab390adf84995a330d7dd56768db7" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40143 } }
I20260810 03:45:18.790222 25756 raft_consensus.cc:388] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:18.790307 25756 raft_consensus.cc:482] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:18.790436 25756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:18.791402 25756 raft_consensus.cc:504] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b98ab390adf84995a330d7dd56768db7" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40143 } }
I20260810 03:45:18.791767 25756 leader_election.cc:302] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b98ab390adf84995a330d7dd56768db7; no voters:
I20260810 03:45:18.792143 25756 leader_election.cc:288] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:18.792245 25761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:18.792500 25761 raft_consensus.cc:686] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [term 1 LEADER]: Becoming Leader. State: Replica: b98ab390adf84995a330d7dd56768db7, State: Running, Role: LEADER
I20260810 03:45:18.793021 25761 consensus_queue.cc:237] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b98ab390adf84995a330d7dd56768db7" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40143 } }
I20260810 03:45:18.793663 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:18.779901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48222 (local address 127.22.134.254:40143)
0810 03:45:18.780355 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:18.780371 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:18.780408 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:45:18.781173 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:18.781192 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:18.781532 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:18.781867 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:18.782702 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:18.783759 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:18.784607 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:18.785194 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:18.785354 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:18.788205 (+ 2851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:18.788212 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:18.788226 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:18.788256 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:18.790246 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:18.790785 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:18.790792 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:18.790799 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:18.790929 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:18.791230 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:18.791234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:18.791235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:18.791733 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:18.791933 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:18.792264 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 03:45:18.792613 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":152,"threads_started":1}
I20260810 03:45:18.793718 25756 sys_catalog.cc:564] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:18.795849 25763 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b98ab390adf84995a330d7dd56768db7. Latest consensus state: current_term: 1 leader_uuid: "b98ab390adf84995a330d7dd56768db7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b98ab390adf84995a330d7dd56768db7" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40143 } } }
I20260810 03:45:18.795991 25763 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:18.796144 25762 sys_catalog.cc:455] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b98ab390adf84995a330d7dd56768db7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b98ab390adf84995a330d7dd56768db7" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40143 } } }
I20260810 03:45:18.796675 25762 sys_catalog.cc:458] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7 [sys.catalog]: This master's current role is: LEADER
W20260810 03:45:18.798758 25775 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:18.798851 25775 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:18.798935 25776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:18.799654 25776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:18.805918 25776 catalog_manager.cc:1347] Generated new cluster ID: ee2f98451e924c4aaf873789eaaf9fb0
I20260810 03:45:18.805994 25776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:18.823064 25776 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:18.824074 25776 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:18.831151 25776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b98ab390adf84995a330d7dd56768db7: Generated new TSK 0
I20260810 03:45:18.831887 25776 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:18.875864 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40143
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:19.004985 25782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:19.005291 25782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:19.005337 25782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:19.009554 25782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:19.009637 25782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:19.009698 25782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:19.015523 25782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:19.016582 25782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:19.017657 25782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:45:19.028093 25782 server_base.cc:1034] running on GCE node
W20260810 03:45:19.028182 25790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:19.028038 25792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:19.028339 25789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:19.028877 25782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:19.029626 25782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:19.030809 25782 hybrid_clock.cc:648] HybridClock initialized: now 1786333519030778 us; error 42 us; skew 500 ppm
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[25669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333519, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:19.034174 25782 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:19.035192 25782 webserver.cc:460] Webserver started at http://127.22.134.193:37329/ using document root <none> and password file <none>
I20260810 03:45:19.035812 25782 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:19.035907 25782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:19.036162 25782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:19.038688 25782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "9b9e4f0b69cd435a9454e8195fc33566"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "6fe967b6c0820ceda4eecc60a9f7204d"
server_key_iv: "78ef7814bab8cb993256e3bd04c0b213"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.039466 25782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "9b9e4f0b69cd435a9454e8195fc33566"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "6fe967b6c0820ceda4eecc60a9f7204d"
server_key_iv: "78ef7814bab8cb993256e3bd04c0b213"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.043804 25782 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 03:45:19.046527 25800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.047838 25782 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:19.047976 25782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "9b9e4f0b69cd435a9454e8195fc33566"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "6fe967b6c0820ceda4eecc60a9f7204d"
server_key_iv: "78ef7814bab8cb993256e3bd04c0b213"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.048100 25782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:19.064914 25782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:19.068415 25782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:19.068647 25782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:19.069355 25782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:19.070245 25782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:19.070317 25782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.070392 25782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:19.070433 25782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.080263 25782 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:37399
I20260810 03:45:19.080286 25928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:37399 every 8 connection(s)
I20260810 03:45:19.081224 25782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:19.084484 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 25782
I20260810 03:45:19.084585 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:19.084940 23067 external_mini_cluster.cc:1428] Setting key 45c34d9ceaa826c78ec4e64a83dd0a67
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[25669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333519, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:19.095547 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:19.083160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:51361 (local address 127.22.134.254:40143)
0810 03:45:19.083310 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:19.083313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:19.084207 (+ 894us) server_negotiation.cc:407] Connection header received
0810 03:45:19.085660 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:19.085662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:19.085712 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:19.085781 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:19.087018 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.087543 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.088694 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.088994 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.089109 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:19.091642 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:19.091645 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:19.091648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:19.091681 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:19.093280 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:19.093805 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:19.093810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:19.093812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:19.093893 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:19.094236 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:19.094241 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:19.094242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:19.094498 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:19.094627 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:19.095218 (+ 591us) server_negotiation.cc:299] Negotiation successful
0810 03:45:19.095357 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:45:19.096541 25931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:19.083559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40143 (local address 127.22.134.193:51361)
0810 03:45:19.083997 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:19.084041 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:19.085461 (+ 1420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:19.085953 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:19.085962 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:19.086394 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:19.086868 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:19.086882 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.087683 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.087686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:19.088564 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:19.088573 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.089155 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.089159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:19.089326 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:19.089963 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:19.089980 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:19.091461 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:19.093407 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:19.093413 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:19.093430 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:19.093703 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:19.093984 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:19.093988 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:19.093990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:19.094141 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:19.094659 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:19.094666 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:19.094963 (+ 297us) client_negotiation.cc:769] Sending connection context
0810 03:45:19.095161 (+ 198us) client_negotiation.cc:240] Negotiation successful
0810 03:45:19.095512 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":117,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:45:19.097929 25929 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40143
I20260810 03:45:19.098300 25929 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:19.098930 25929 heartbeater.cc:511] Master 127.22.134.254:40143 requested a full tablet report, sending...
I20260810 03:45:19.100595 25717 ts_manager.cc:194] Registered new tserver with Master: 9b9e4f0b69cd435a9454e8195fc33566 (127.22.134.193:37399)
I20260810 03:45:19.101764 25717 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:51361
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:19.117080 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40143
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:19.233191 25934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:19.233476 25934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:19.233520 25934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:19.237645 25934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:19.237723 25934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:19.237785 25934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:19.243510 25934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:19.244618 25934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:19.245708 25934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:19.255448 25944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:19.255451 25941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:19.255451 25942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:19.255525 25934 server_base.cc:1034] running on GCE node
I20260810 03:45:19.256165 25934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:19.256840 25934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:19.258006 25934 hybrid_clock.cc:648] HybridClock initialized: now 1786333519257993 us; error 25 us; skew 500 ppm
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[25669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333519, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:19.260963 25934 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:19.261803 25934 webserver.cc:460] Webserver started at http://127.22.134.194:33019/ using document root <none> and password file <none>
I20260810 03:45:19.262364 25934 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:19.262425 25934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:19.262593 25934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:19.264649 25934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "5c888ffc8fe84f089474cb30091f6b07"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "ab08d1cb0e22ddf450de17be465c972f"
server_key_iv: "9b4a05027fd59e75cd55bebb28d69b40"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.265245 25934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "5c888ffc8fe84f089474cb30091f6b07"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "ab08d1cb0e22ddf450de17be465c972f"
server_key_iv: "9b4a05027fd59e75cd55bebb28d69b40"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.269276 25934 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:45:19.271843 25951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.273247 25934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:19.273378 25934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "5c888ffc8fe84f089474cb30091f6b07"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "ab08d1cb0e22ddf450de17be465c972f"
server_key_iv: "9b4a05027fd59e75cd55bebb28d69b40"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.273497 25934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:19.288327 25934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:19.291744 25934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:19.291957 25934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:19.292582 25934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:19.293605 25934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:19.293655 25934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.293699 25934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:19.293713 25934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.303061 25934 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:38559
I20260810 03:45:19.303087 26072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:38559 every 8 connection(s)
I20260810 03:45:19.304059 25934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:19.304579 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 25934
I20260810 03:45:19.304714 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:19.305038 23067 external_mini_cluster.cc:1428] Setting key 8122fbe12408f7de7af43d946c76bd05
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[25669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333519, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
I20260810 03:45:19.318938 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:19.306092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:54107 (local address 127.22.134.254:40143)
0810 03:45:19.306231 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:19.306236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:19.307236 (+ 1000us) server_negotiation.cc:407] Connection header received
0810 03:45:19.308558 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:19.308561 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:19.308619 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:19.308700 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:19.309896 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.310437 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.311585 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.311819 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.311927 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:19.314867 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:19.314870 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:19.314872 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:19.314898 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:19.316379 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:19.316919 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:19.316948 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:19.316950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:19.317029 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:19.317483 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:19.317486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:19.317487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:19.317780 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:19.317891 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:19.318507 (+ 616us) server_negotiation.cc:299] Negotiation successful
0810 03:45:19.318659 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:45:19.319579 26075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:19.306606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40143 (local address 127.22.134.194:54107)
0810 03:45:19.307076 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:19.307135 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:19.308354 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:19.308894 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:19.308901 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:19.309271 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:19.309751 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:19.309764 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.310566 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.310569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:19.311456 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:19.311465 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.311970 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.311975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:19.312144 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:19.312862 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:19.312878 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:19.314688 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:19.316488 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:19.316493 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:19.316506 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:19.316833 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:19.317157 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:19.317160 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:19.317161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:19.317291 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:19.317925 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:19.317939 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:19.318244 (+ 305us) client_negotiation.cc:769] Sending connection context
0810 03:45:19.318400 (+ 156us) client_negotiation.cc:240] Negotiation successful
0810 03:45:19.318666 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":136,"threads_started":1}
I20260810 03:45:19.321066 26073 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40143
I20260810 03:45:19.321331 26073 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:19.321839 26073 heartbeater.cc:511] Master 127.22.134.254:40143 requested a full tablet report, sending...
I20260810 03:45:19.322937 25717 ts_manager.cc:194] Registered new tserver with Master: 5c888ffc8fe84f089474cb30091f6b07 (127.22.134.194:38559)
I20260810 03:45:19.323599 25717 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:54107
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:19.336158 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40143
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:19.451864 26078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:19.452158 26078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:19.452237 26078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:19.456424 26078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:19.456516 26078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:19.456827 26078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:19.462906 26078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:19.464097 26078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:19.465233 26078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:19.475476 26083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:19.475726 26078 server_base.cc:1034] running on GCE node
W20260810 03:45:19.475476 26086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:19.475575 26084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:19.476318 26078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:19.477092 26078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:19.478258 26078 hybrid_clock.cc:648] HybridClock initialized: now 1786333519478245 us; error 26 us; skew 500 ppm
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[25669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333519, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:19.481427 26078 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:19.482319 26078 webserver.cc:460] Webserver started at http://127.22.134.195:35059/ using document root <none> and password file <none>
I20260810 03:45:19.482950 26078 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:19.483023 26078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:19.483271 26078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:19.485497 26078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "f55f6aae07614885a21c145b93d81209"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "6aeba52ac21fbe5c49f3bfaaaf499fe0"
server_key_iv: "7ec0ef12ec6e59cb7c4c064231f882d3"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.486066 26078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "f55f6aae07614885a21c145b93d81209"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "6aeba52ac21fbe5c49f3bfaaaf499fe0"
server_key_iv: "7ec0ef12ec6e59cb7c4c064231f882d3"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.490231 26078 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:19.493280 26093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.494808 26078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:19.494940 26078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "f55f6aae07614885a21c145b93d81209"
format_stamp: "Formatted at 2026-08-10 03:45:19 on dist-test-slave-qg60"
server_key: "6aeba52ac21fbe5c49f3bfaaaf499fe0"
server_key_iv: "7ec0ef12ec6e59cb7c4c064231f882d3"
server_key_version: "encryptionkey@0"
I20260810 03:45:19.495061 26078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:19.505177 26078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:19.508584 26078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:19.508842 26078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:19.509492 26078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:19.510365 26078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:19.510437 26078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.510507 26078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:19.510546 26078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:19.519764 26078 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:38225
I20260810 03:45:19.519791 26214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:38225 every 8 connection(s)
I20260810 03:45:19.520774 26078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:19.523524 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 26078
I20260810 03:45:19.523698 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:19.524060 23067 external_mini_cluster.cc:1428] Setting key 40c18f00e835947663d995808563b5ca
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[25669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333519, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:19.535517 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:19.522564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:45667 (local address 127.22.134.254:40143)
0810 03:45:19.522726 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:19.522730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:19.523594 (+ 864us) server_negotiation.cc:407] Connection header received
0810 03:45:19.525542 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:19.525548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:19.525614 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:19.525705 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:19.527046 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.527582 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.528855 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.529083 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.529177 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:19.531713 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:19.531717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:19.531719 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:19.531746 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:19.533186 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:19.533719 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:19.533721 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:19.533722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:19.533799 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:19.534231 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:19.534234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:19.534236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:19.534440 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:19.534536 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:19.535261 (+ 725us) server_negotiation.cc:299] Negotiation successful
0810 03:45:19.535385 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 03:45:19.536378 26217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:19.522907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40143 (local address 127.22.134.195:45667)
0810 03:45:19.523410 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:19.523474 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:19.525301 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:19.525889 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:19.525896 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:19.526317 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:19.526917 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:19.526931 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.527705 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.527707 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:19.528656 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:19.528666 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:19.529225 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:19.529228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:19.529380 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:19.529956 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:19.529972 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:19.531503 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:19.533301 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:19.533306 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:19.533320 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:19.533623 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:19.533910 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:19.533912 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:19.533914 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:19.534066 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:19.534576 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:19.534584 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:19.534851 (+ 267us) client_negotiation.cc:769] Sending connection context
0810 03:45:19.535025 (+ 174us) client_negotiation.cc:240] Negotiation successful
0810 03:45:19.535357 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":127,"threads_started":1}
I20260810 03:45:19.537840 26215 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40143
I20260810 03:45:19.538200 26215 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:19.538811 26215 heartbeater.cc:511] Master 127.22.134.254:40143 requested a full tablet report, sending...
I20260810 03:45:19.540026 25717 ts_manager.cc:194] Registered new tserver with Master: f55f6aae07614885a21c145b93d81209 (127.22.134.195:38225)
I20260810 03:45:19.540611 25717 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:45667
I20260810 03:45:19.550469 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 03:45:19.566242 25759 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:19.564654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.22.134.254:40143)
0810 03:45:19.564854 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:19.564859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:19.565034 (+ 175us) server_negotiation.cc:407] Connection header received
0810 03:45:19.565232 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:19.565235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:19.565280 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:19.565365 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:19.566126 (+ 761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48228: BlockingRecv error: recv got EOF from 127.0.0.1:48228 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:45:19.567335 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 25782
I20260810 03:45:19.575537 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 25934
I20260810 03:45:19.584658 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 26078
I20260810 03:45:19.591655 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 25682
2026-08-10T03:45:19Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2302 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[26227](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[26227](info): set up 2 sockets
Aug 10 03:45:19 dist-test-slave-qg60 krb5kdc[26227](info): commencing operation
krb5kdc: starting...
W20260810 03:45:20.692400 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:20 dist-test-slave-qg60 krb5kdc[26227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:20.836162 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:41111
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:41111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:20.947903 26241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:20.948212 26241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:20.948297 26241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:20.952281 26241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:20.952379 26241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:20.952418 26241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:20.952457 26241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:20.952493 26241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:20.957719 26241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:41111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:41111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:20.958832 26241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:20.959856 26241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:20.969020 26249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:20.969175 26241 server_base.cc:1034] running on GCE node
W20260810 03:45:20.969261 26247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:20.969439 26246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:20.970045 26241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:20.971434 26241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:20.978832 26241 hybrid_clock.cc:648] HybridClock initialized: now 1786333520978792 us; error 54 us; skew 500 ppm
Aug 10 03:45:20 dist-test-slave-qg60 krb5kdc[26227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333520, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:20.982723 26241 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:20.983753 26241 webserver.cc:460] Webserver started at http://127.22.134.254:41509/ using document root <none> and password file <none>
I20260810 03:45:20.984376 26241 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:20.984447 26241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:20.984710 26241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:20.986940 26241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "7c733cd258a84b12ac3d07240895907d"
format_stamp: "Formatted at 2026-08-10 03:45:20 on dist-test-slave-qg60"
server_key: "93cc66fbff51d29582880586c75d8319"
server_key_iv: "3d47e5832b15cea183abe2e9c1ba34f2"
server_key_version: "encryptionkey@0"
I20260810 03:45:20.987528 26241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "7c733cd258a84b12ac3d07240895907d"
format_stamp: "Formatted at 2026-08-10 03:45:20 on dist-test-slave-qg60"
server_key: "93cc66fbff51d29582880586c75d8319"
server_key_iv: "3d47e5832b15cea183abe2e9c1ba34f2"
server_key_version: "encryptionkey@0"
I20260810 03:45:20.991392 26241 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:45:20.993986 26256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:20.995314 26241 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:20.995476 26241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "7c733cd258a84b12ac3d07240895907d"
format_stamp: "Formatted at 2026-08-10 03:45:20 on dist-test-slave-qg60"
server_key: "93cc66fbff51d29582880586c75d8319"
server_key_iv: "3d47e5832b15cea183abe2e9c1ba34f2"
server_key_version: "encryptionkey@0"
I20260810 03:45:20.995584 26241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:21.016705 26241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:21.020481 26241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:21.020712 26241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:21.028501 26241 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:41111
I20260810 03:45:21.028898 26310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:41111 every 8 connection(s)
I20260810 03:45:21.029627 26241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:21.032800 26311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:21.033946 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 26241
I20260810 03:45:21.034149 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:21.034443 23067 external_mini_cluster.cc:1428] Setting key b9e64cd1d57bf8bfa8a22faced77a933
I20260810 03:45:21.040719 26311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d: Bootstrap starting.
I20260810 03:45:21.043942 26311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d: Neither blocks nor log segments found. Creating new log.
Aug 10 03:45:21 dist-test-slave-qg60 krb5kdc[26227](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:21.044852 26311 log.cc:824] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:21.047091 26311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d: No bootstrap required, opened a new log
I20260810 03:45:21.050021 26314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:21.035936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49102 (local address 127.22.134.254:41111)
0810 03:45:21.036372 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:21.036388 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:21.036425 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:45:21.037144 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:21.037163 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:21.037519 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:21.037817 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:21.038956 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:21.040094 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:21.041400 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:21.041906 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:21.042041 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:21.045264 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:21.045270 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:21.045285 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:21.045316 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:21.047064 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:21.047566 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:21.047571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:21.047582 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:21.047699 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:21.047996 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:21.048000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:21.048002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:21.048415 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:21.048648 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:21.048934 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 03:45:21.049261 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":135,"threads_started":1}
I20260810 03:45:21.051064 26311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c733cd258a84b12ac3d07240895907d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41111 } }
I20260810 03:45:21.051316 26311 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:21.051411 26311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c733cd258a84b12ac3d07240895907d, State: Initialized, Role: FOLLOWER
I20260810 03:45:21.051848 26311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c733cd258a84b12ac3d07240895907d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41111 } }
I20260810 03:45:21.052026 26311 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:21.052100 26311 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:21.052199 26311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:21.053067 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:45:21.053360 26311 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c733cd258a84b12ac3d07240895907d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41111 } }
I20260810 03:45:21.053748 26311 leader_election.cc:302] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c733cd258a84b12ac3d07240895907d; no voters:
I20260810 03:45:21.054126 26311 leader_election.cc:288] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:21.054288 26317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:21.054558 26317 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [term 1 LEADER]: Becoming Leader. State: Replica: 7c733cd258a84b12ac3d07240895907d, State: Running, Role: LEADER
I20260810 03:45:21.054919 26317 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c733cd258a84b12ac3d07240895907d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41111 } }
I20260810 03:45:21.055586 26311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:21.056228 26318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c733cd258a84b12ac3d07240895907d. Latest consensus state: current_term: 1 leader_uuid: "7c733cd258a84b12ac3d07240895907d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c733cd258a84b12ac3d07240895907d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41111 } } }
I20260810 03:45:21.056370 26318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:21.056679 26319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c733cd258a84b12ac3d07240895907d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c733cd258a84b12ac3d07240895907d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41111 } } }
I20260810 03:45:21.056818 26319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:21.057749 26324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:21.061744 26324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:21.068349 26324 catalog_manager.cc:1347] Generated new cluster ID: 60df2b763fd54f07b5c180f9b8189263
I20260810 03:45:21.068528 26324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:21.078966 26314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:21.072189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.22.134.254:41111)
0810 03:45:21.072293 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:21.072297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:21.072544 (+ 247us) server_negotiation.cc:407] Connection header received
0810 03:45:21.072716 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:21.072720 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:21.072789 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:21.072836 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:21.073538 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:21.074632 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:21.075953 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:21.076329 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:21.076395 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:21.077780 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:21.077784 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:21.077787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:21.078493 (+ 706us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:21.078532 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:21.078551 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:21.078643 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:21.078746 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 03:45:21.078809 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 03:45:21.102180 26324 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:21.103523 26324 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:21.112911 26324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c733cd258a84b12ac3d07240895907d: Generated new TSK 0
I20260810 03:45:21.113698 26324 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:45:21.125061 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 26241
2026-08-10T03:45:21Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1534 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:21 dist-test-slave-qg60 krb5kdc[26348](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:21 dist-test-slave-qg60 krb5kdc[26348](info): set up 2 sockets
Aug 10 03:45:21 dist-test-slave-qg60 krb5kdc[26348](info): commencing operation
krb5kdc: starting...
W20260810 03:45:22.242563 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:22 dist-test-slave-qg60 krb5kdc[26348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:22.376983 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:36277
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:36277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:22.492378 26361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:22.492823 26361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:22.492942 26361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:22.497633 26361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:22.497699 26361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:22.497717 26361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:22.497735 26361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:22.497750 26361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:22.503212 26361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:36277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:36277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:22.504396 26361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:22.505540 26361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:22.514149 26366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:22.514145 26367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:22.514149 26369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:22.514654 26361 server_base.cc:1034] running on GCE node
I20260810 03:45:22.515214 26361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:22.516263 26361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:22.517421 26361 hybrid_clock.cc:648] HybridClock initialized: now 1786333522517397 us; error 42 us; skew 500 ppm
Aug 10 03:45:22 dist-test-slave-qg60 krb5kdc[26348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333522, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:22.524842 26361 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:22.525799 26361 webserver.cc:460] Webserver started at http://127.22.134.254:32949/ using document root <none> and password file <none>
I20260810 03:45:22.526343 26361 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:22.526401 26361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:22.526568 26361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:22.528594 26361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "a9d9760706594bfb91f045a08ee54f2d"
format_stamp: "Formatted at 2026-08-10 03:45:22 on dist-test-slave-qg60"
server_key: "9e1ee05f19d136f70247accdac1f32a0"
server_key_iv: "a3d72a15f783579c4b1143278da57611"
server_key_version: "encryptionkey@0"
I20260810 03:45:22.529234 26361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "a9d9760706594bfb91f045a08ee54f2d"
format_stamp: "Formatted at 2026-08-10 03:45:22 on dist-test-slave-qg60"
server_key: "9e1ee05f19d136f70247accdac1f32a0"
server_key_iv: "a3d72a15f783579c4b1143278da57611"
server_key_version: "encryptionkey@0"
I20260810 03:45:22.533099 26361 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:45:22.535631 26377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:22.537122 26361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:22.537254 26361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "a9d9760706594bfb91f045a08ee54f2d"
format_stamp: "Formatted at 2026-08-10 03:45:22 on dist-test-slave-qg60"
server_key: "9e1ee05f19d136f70247accdac1f32a0"
server_key_iv: "a3d72a15f783579c4b1143278da57611"
server_key_version: "encryptionkey@0"
I20260810 03:45:22.537354 26361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:22.553530 26361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:22.556670 26361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:22.556859 26361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:22.563691 26361 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:36277
I20260810 03:45:22.563974 26432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:36277 every 8 connection(s)
I20260810 03:45:22.564692 26361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:22.567565 26433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:22.573532 26433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d: Bootstrap starting.
I20260810 03:45:22.574704 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 26361
I20260810 03:45:22.574856 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:22.575170 23067 external_mini_cluster.cc:1428] Setting key b434ca7533fb1cdd286d86e78635188a
I20260810 03:45:22.576618 26433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:22.577621 26433 log.cc:824] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:22.579854 26433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d: No bootstrap required, opened a new log
I20260810 03:45:22.584188 26433 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9d9760706594bfb91f045a08ee54f2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36277 } }
I20260810 03:45:22.584415 26433 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:22.584474 26433 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d9760706594bfb91f045a08ee54f2d, State: Initialized, Role: FOLLOWER
Aug 10 03:45:22 dist-test-slave-qg60 krb5kdc[26348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:22.585018 26433 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9d9760706594bfb91f045a08ee54f2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36277 } }
I20260810 03:45:22.585171 26433 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:22.585254 26433 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:22.585356 26433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:22.586732 26433 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9d9760706594bfb91f045a08ee54f2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36277 } }
I20260810 03:45:22.587141 26433 leader_election.cc:302] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9d9760706594bfb91f045a08ee54f2d; no voters:
I20260810 03:45:22.587529 26433 leader_election.cc:288] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:22.587641 26438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:22.587934 26438 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [term 1 LEADER]: Becoming Leader. State: Replica: a9d9760706594bfb91f045a08ee54f2d, State: Running, Role: LEADER
I20260810 03:45:22.588255 26438 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9d9760706594bfb91f045a08ee54f2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36277 } }
I20260810 03:45:22.589133 26433 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:22.589893 26439 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9d9760706594bfb91f045a08ee54f2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9d9760706594bfb91f045a08ee54f2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36277 } } }
I20260810 03:45:22.590023 26439 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:22.590415 26440 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9d9760706594bfb91f045a08ee54f2d. Latest consensus state: current_term: 1 leader_uuid: "a9d9760706594bfb91f045a08ee54f2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9d9760706594bfb91f045a08ee54f2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36277 } } }
I20260810 03:45:22.590572 26440 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:22.590891 26446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:22.592162 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:22.576448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34182 (local address 127.22.134.254:36277)
0810 03:45:22.577036 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:22.577054 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:22.577107 (+ 53us) server_negotiation.cc:407] Connection header received
0810 03:45:22.578048 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:22.578080 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:22.578452 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:22.578821 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:22.579487 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:22.581003 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:22.581865 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:22.582610 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:22.582837 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:22.585659 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:22.585665 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:22.585684 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:22.585722 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:22.587868 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:22.588429 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:22.588435 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:22.588440 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:22.588583 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:22.588945 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:22.588949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:22.588951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:22.589514 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:22.590526 (+ 1012us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:22.590684 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 03:45:22.591038 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":240,"threads_started":1}
I20260810 03:45:22.594732 26446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:22.601424 26446 catalog_manager.cc:1347] Generated new cluster ID: e4968b7ac2ba437883d42efc2afa4f02
I20260810 03:45:22.601498 26446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:22.607764 26446 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:22.609071 26446 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:22.619508 26446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9d9760706594bfb91f045a08ee54f2d: Generated new TSK 0
I20260810 03:45:22.620402 26446 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:22.652242 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36277
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:22.769048 26459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:22.769338 26459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:22.769385 26459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:22.773706 26459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:22.773772 26459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:22.773833 26459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:22.779299 26459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:22.780366 26459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:22.781461 26459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:22.792003 26466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:22.791975 26465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:22.792004 26468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:22.792212 26459 server_base.cc:1034] running on GCE node
I20260810 03:45:22.792901 26459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:22.793498 26459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:22.794657 26459 hybrid_clock.cc:648] HybridClock initialized: now 1786333522794641 us; error 27 us; skew 500 ppm
Aug 10 03:45:22 dist-test-slave-qg60 krb5kdc[26348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333522, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:22.797621 26459 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:22.798640 26459 webserver.cc:460] Webserver started at http://127.22.134.193:37963/ using document root <none> and password file <none>
I20260810 03:45:22.799324 26459 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:22.799394 26459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:22.799602 26459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:22.801959 26459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "12679d1a631e4132b283c8ae148ff5a8"
format_stamp: "Formatted at 2026-08-10 03:45:22 on dist-test-slave-qg60"
server_key: "a55d6dad7bba92b720145f90fac77327"
server_key_iv: "8c8873f9f4013a9fb109d970b8de859a"
server_key_version: "encryptionkey@0"
I20260810 03:45:22.802503 26459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "12679d1a631e4132b283c8ae148ff5a8"
format_stamp: "Formatted at 2026-08-10 03:45:22 on dist-test-slave-qg60"
server_key: "a55d6dad7bba92b720145f90fac77327"
server_key_iv: "8c8873f9f4013a9fb109d970b8de859a"
server_key_version: "encryptionkey@0"
I20260810 03:45:22.806335 26459 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:22.808887 26477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:22.810185 26459 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:22.810316 26459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "12679d1a631e4132b283c8ae148ff5a8"
format_stamp: "Formatted at 2026-08-10 03:45:22 on dist-test-slave-qg60"
server_key: "a55d6dad7bba92b720145f90fac77327"
server_key_iv: "8c8873f9f4013a9fb109d970b8de859a"
server_key_version: "encryptionkey@0"
I20260810 03:45:22.810428 26459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:22.836491 26459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:22.839880 26459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:22.840101 26459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:22.840914 26459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:22.841876 26459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:22.841945 26459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:22.842010 26459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:22.842062 26459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:22.851285 26459 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:43619
I20260810 03:45:22.851333 26599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:43619 every 8 connection(s)
I20260810 03:45:22.852262 26459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:22.859845 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 26459
I20260810 03:45:22.860018 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:22.860338 23067 external_mini_cluster.cc:1428] Setting key 8f7747875190b89d0a3e75bad0ed590d
Aug 10 03:45:22 dist-test-slave-qg60 krb5kdc[26348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333522, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:22.867307 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:22.854270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:48633 (local address 127.22.134.254:36277)
0810 03:45:22.854416 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:22.854420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:22.855244 (+ 824us) server_negotiation.cc:407] Connection header received
0810 03:45:22.856687 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:22.856691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:22.856776 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:22.856888 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:22.858093 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:22.858638 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:22.859942 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:22.860271 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:22.860364 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:22.863157 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:22.863160 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:22.863185 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:22.863208 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:22.864996 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:22.865521 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:22.865528 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:22.865533 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:22.865631 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:22.865963 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:22.865968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:22.865973 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:22.866258 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:22.866366 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:22.866883 (+ 517us) server_negotiation.cc:299] Negotiation successful
0810 03:45:22.867038 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:45:22.868072 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:22.854620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:36277 (local address 127.22.134.193:48633)
0810 03:45:22.855069 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:22.855126 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:22.856413 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:22.857063 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:22.857070 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:22.857436 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:22.857931 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:22.857945 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:22.858773 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:22.858779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:22.859779 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:22.859791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:22.860439 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:22.860444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:22.860655 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:22.861365 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:22.861382 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:22.862970 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:22.865135 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:22.865140 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:22.865154 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:22.865422 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:22.865730 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:22.865732 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:22.865733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:22.865870 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:22.866376 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:22.866381 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:22.866631 (+ 250us) client_negotiation.cc:769] Sending connection context
0810 03:45:22.866795 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 03:45:22.867158 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":105,"threads_started":1}
I20260810 03:45:22.869441 26600 heartbeater.cc:347] Connected to a master server at 127.22.134.254:36277
I20260810 03:45:22.869680 26600 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:22.870194 26600 heartbeater.cc:511] Master 127.22.134.254:36277 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:22.871786 26395 ts_manager.cc:194] Registered new tserver with Master: 12679d1a631e4132b283c8ae148ff5a8 (127.22.134.193:43619)
I20260810 03:45:22.873044 26395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:48633
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:22.893332 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36277
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:23.006848 26605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:23.007193 26605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:23.007287 26605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:23.011382 26605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:23.011488 26605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:23.011590 26605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:23.017133 26605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:23.018317 26605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:23.019373 26605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:23.029524 26613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:23.029569 26611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:23.029722 26605 server_base.cc:1034] running on GCE node
W20260810 03:45:23.029886 26610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:23.030403 26605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:23.031133 26605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:23.032332 26605 hybrid_clock.cc:648] HybridClock initialized: now 1786333523032312 us; error 31 us; skew 500 ppm
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333523, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:23.035578 26605 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:23.036576 26605 webserver.cc:460] Webserver started at http://127.22.134.194:42865/ using document root <none> and password file <none>
I20260810 03:45:23.037240 26605 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:23.037305 26605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:23.037536 26605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:23.039726 26605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "2043beb811ff4b169c3101cfb1191e09"
format_stamp: "Formatted at 2026-08-10 03:45:23 on dist-test-slave-qg60"
server_key: "892c7af5b75558bc17da761672b5f2a9"
server_key_iv: "ff9a516a86601aac4e249bd219c37d20"
server_key_version: "encryptionkey@0"
I20260810 03:45:23.040328 26605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "2043beb811ff4b169c3101cfb1191e09"
format_stamp: "Formatted at 2026-08-10 03:45:23 on dist-test-slave-qg60"
server_key: "892c7af5b75558bc17da761672b5f2a9"
server_key_iv: "ff9a516a86601aac4e249bd219c37d20"
server_key_version: "encryptionkey@0"
I20260810 03:45:23.044411 26605 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 03:45:23.046905 26620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:23.048362 26605 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:23.048460 26605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "2043beb811ff4b169c3101cfb1191e09"
format_stamp: "Formatted at 2026-08-10 03:45:23 on dist-test-slave-qg60"
server_key: "892c7af5b75558bc17da761672b5f2a9"
server_key_iv: "ff9a516a86601aac4e249bd219c37d20"
server_key_version: "encryptionkey@0"
I20260810 03:45:23.048600 26605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:23.066184 26605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:23.069439 26605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:23.069649 26605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:23.070279 26605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:23.071127 26605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:23.071202 26605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:23.071286 26605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:23.071336 26605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:23.080695 26605 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:40953
I20260810 03:45:23.080796 26745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:40953 every 8 connection(s)
I20260810 03:45:23.081671 26605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:23.090822 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 26605
I20260810 03:45:23.090960 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:23.091250 23067 external_mini_cluster.cc:1428] Setting key a30650df9d7f72963df05c3c589fd883
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333523, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:23.096890 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:23.083789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:59877 (local address 127.22.134.254:36277)
0810 03:45:23.083933 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:23.083937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:23.084866 (+ 929us) server_negotiation.cc:407] Connection header received
0810 03:45:23.086197 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:23.086200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:23.086251 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:23.086335 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:23.087450 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.088043 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.089253 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.089553 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.089713 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:23.092684 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:23.092691 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:23.092697 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:23.092731 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:23.094545 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:23.095047 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:23.095054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:23.095058 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:23.095162 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:23.095619 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:23.095622 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:23.095624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:23.095819 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:23.095910 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:23.096583 (+ 673us) server_negotiation.cc:299] Negotiation successful
0810 03:45:23.096694 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:45:23.097720 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:23.084200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:36277 (local address 127.22.134.194:59877)
0810 03:45:23.084657 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:23.084713 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:23.085984 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:23.086488 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:23.086495 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:23.086859 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:23.087319 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:23.087332 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.088163 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.088166 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:23.089128 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:23.089137 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.089753 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.089756 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:23.089889 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:23.090605 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:23.090628 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:23.092494 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:23.094669 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:23.094676 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:23.094689 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:23.094946 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:23.095275 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:23.095281 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:23.095284 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:23.095492 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:23.095932 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:23.095940 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:23.096304 (+ 364us) client_negotiation.cc:769] Sending connection context
0810 03:45:23.096530 (+ 226us) client_negotiation.cc:240] Negotiation successful
0810 03:45:23.096880 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":117,"threads_started":1}
I20260810 03:45:23.098896 26746 heartbeater.cc:347] Connected to a master server at 127.22.134.254:36277
I20260810 03:45:23.099184 26746 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:23.099803 26746 heartbeater.cc:511] Master 127.22.134.254:36277 requested a full tablet report, sending...
I20260810 03:45:23.101044 26395 ts_manager.cc:194] Registered new tserver with Master: 2043beb811ff4b169c3101cfb1191e09 (127.22.134.194:40953)
I20260810 03:45:23.101858 26395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:59877
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:23.125284 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36277
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:23.241586 26751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:23.241917 26751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:23.241962 26751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:23.245993 26751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:23.246057 26751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:23.246114 26751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:23.251520 26751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:23.252633 26751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:23.253748 26751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:23.264261 26757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:23.264321 26751 server_base.cc:1034] running on GCE node
W20260810 03:45:23.264261 26760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:23.264281 26758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:23.265095 26751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:23.265865 26751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:23.267094 26751 hybrid_clock.cc:648] HybridClock initialized: now 1786333523267062 us; error 47 us; skew 500 ppm
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333523, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:23.270054 26751 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:23.271008 26751 webserver.cc:460] Webserver started at http://127.22.134.195:37469/ using document root <none> and password file <none>
I20260810 03:45:23.271636 26751 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:23.271739 26751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:23.271986 26751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:23.274255 26751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "30cca362cc964ab9ab8e94c3a009d303"
format_stamp: "Formatted at 2026-08-10 03:45:23 on dist-test-slave-qg60"
server_key: "4196673fc74dc90f1daae5fd0b68767e"
server_key_iv: "25baefc12f2c9be9d3d5cd910dee3491"
server_key_version: "encryptionkey@0"
I20260810 03:45:23.274848 26751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "30cca362cc964ab9ab8e94c3a009d303"
format_stamp: "Formatted at 2026-08-10 03:45:23 on dist-test-slave-qg60"
server_key: "4196673fc74dc90f1daae5fd0b68767e"
server_key_iv: "25baefc12f2c9be9d3d5cd910dee3491"
server_key_version: "encryptionkey@0"
I20260810 03:45:23.278755 26751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:23.281298 26768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:23.282508 26751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:23.282675 26751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "30cca362cc964ab9ab8e94c3a009d303"
format_stamp: "Formatted at 2026-08-10 03:45:23 on dist-test-slave-qg60"
server_key: "4196673fc74dc90f1daae5fd0b68767e"
server_key_iv: "25baefc12f2c9be9d3d5cd910dee3491"
server_key_version: "encryptionkey@0"
I20260810 03:45:23.282799 26751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:23.299391 26751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:23.302762 26751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:23.303011 26751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:23.303685 26751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:23.304596 26751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:23.304673 26751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:23.304797 26751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:23.304855 26751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:23.315711 26751 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:41995
I20260810 03:45:23.315733 26891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:41995 every 8 connection(s)
I20260810 03:45:23.316704 26751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:23.323133 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 26751
I20260810 03:45:23.323239 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:23.323549 23067 external_mini_cluster.cc:1428] Setting key 6bbc4d15ed67e3253780cfd721425c54
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333523, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:23.331759 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:23.318671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:39321 (local address 127.22.134.254:36277)
0810 03:45:23.318825 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:23.318829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:23.319842 (+ 1013us) server_negotiation.cc:407] Connection header received
0810 03:45:23.321344 (+ 1502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:23.321348 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:23.321411 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:23.321526 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:23.322861 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.323564 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.325029 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.325279 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.325399 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:23.328095 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:23.328098 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:23.328101 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:23.328127 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:23.329799 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:23.330327 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:23.330330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:23.330331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:23.330406 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:23.330732 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:23.330734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:23.330735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:23.330909 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:23.330982 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:23.331525 (+ 543us) server_negotiation.cc:299] Negotiation successful
0810 03:45:23.331627 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:23.332635 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:23.319199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:36277 (local address 127.22.134.195:39321)
0810 03:45:23.319677 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:23.319724 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:23.321119 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:23.321770 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:23.321778 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:23.322169 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:23.322699 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:23.322713 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.323724 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.323727 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:23.324883 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:23.324893 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.325456 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.325461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:23.325703 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:23.326297 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:23.326315 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:23.327933 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:23.329933 (+ 2000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:23.329938 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:23.329951 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:23.330233 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:23.330490 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:23.330492 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:23.330494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:23.330651 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:23.331055 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:23.331061 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:23.331306 (+ 245us) client_negotiation.cc:769] Sending connection context
0810 03:45:23.331473 (+ 167us) client_negotiation.cc:240] Negotiation successful
0810 03:45:23.331758 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":109,"threads_started":1}
I20260810 03:45:23.333832 26892 heartbeater.cc:347] Connected to a master server at 127.22.134.254:36277
I20260810 03:45:23.334079 26892 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:23.334535 26892 heartbeater.cc:511] Master 127.22.134.254:36277 requested a full tablet report, sending...
I20260810 03:45:23.335507 26395 ts_manager.cc:194] Registered new tserver with Master: 30cca362cc964ab9ab8e94c3a009d303 (127.22.134.195:41995)
I20260810 03:45:23.336138 26395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:39321
I20260810 03:45:23.337625 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333523, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333523, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:23.364193 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:23.355757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56786 (local address 127.22.134.254:36277)
0810 03:45:23.355899 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:23.355903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:23.356059 (+ 156us) server_negotiation.cc:407] Connection header received
0810 03:45:23.356177 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:23.356180 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:23.356227 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:23.356307 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:23.357093 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.357620 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.358407 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:23.358613 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:23.358690 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:23.361193 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:23.361197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:23.361199 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:23.361225 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:23.362720 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:23.363106 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:23.363109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:23.363110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:23.363188 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:23.363412 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:23.363414 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:23.363415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:23.363642 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:23.363746 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:23.363943 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 03:45:23.364044 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 03:45:23.364610 26394 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56786
I20260810 03:45:23.365736 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 26459
I20260810 03:45:23.378384 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 26605
I20260810 03:45:23.386456 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 26751
I20260810 03:45:23.394409 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 26361
2026-08-10T03:45:23Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2270 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26907](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26907](info): set up 2 sockets
Aug 10 03:45:23 dist-test-slave-qg60 krb5kdc[26907](info): commencing operation
krb5kdc: starting...
W20260810 03:45:24.517078 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:24 dist-test-slave-qg60 krb5kdc[26907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:24.649861 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:37587
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:37587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:24.765759 26922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:24.766117 26922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:24.766199 26922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:24.770267 26922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:24.770357 26922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:24.770394 26922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:24.770453 26922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:24.770493 26922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:24.775848 26922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:37587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:37587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:24.776945 26922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:24.777968 26922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:24.786823 26927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:24.786828 26930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:24.786846 26928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:24.786841 26922 server_base.cc:1034] running on GCE node
I20260810 03:45:24.787659 26922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:24.788862 26922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:24.790077 26922 hybrid_clock.cc:648] HybridClock initialized: now 1786333524790058 us; error 34 us; skew 500 ppm
Aug 10 03:45:24 dist-test-slave-qg60 krb5kdc[26907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333524, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:24.793004 26922 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:24.793987 26922 webserver.cc:460] Webserver started at http://127.22.134.254:40127/ using document root <none> and password file <none>
I20260810 03:45:24.794581 26922 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:24.794675 26922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:24.794889 26922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:24.797137 26922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "773840dddbb14cbc8fadf98840f3672d"
format_stamp: "Formatted at 2026-08-10 03:45:24 on dist-test-slave-qg60"
server_key: "8afdff251af6ddb1a81894f875ea0a0a"
server_key_iv: "b59430603f476fdef9cf0343ac977f61"
server_key_version: "encryptionkey@0"
I20260810 03:45:24.797776 26922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "773840dddbb14cbc8fadf98840f3672d"
format_stamp: "Formatted at 2026-08-10 03:45:24 on dist-test-slave-qg60"
server_key: "8afdff251af6ddb1a81894f875ea0a0a"
server_key_iv: "b59430603f476fdef9cf0343ac977f61"
server_key_version: "encryptionkey@0"
I20260810 03:45:24.801635 26922 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:24.804075 26938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:24.805397 26922 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:24.805567 26922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "773840dddbb14cbc8fadf98840f3672d"
format_stamp: "Formatted at 2026-08-10 03:45:24 on dist-test-slave-qg60"
server_key: "8afdff251af6ddb1a81894f875ea0a0a"
server_key_iv: "b59430603f476fdef9cf0343ac977f61"
server_key_version: "encryptionkey@0"
I20260810 03:45:24.805693 26922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:24.835075 26922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:24.838053 26922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:24.838275 26922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:24.845708 26922 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:37587
I20260810 03:45:24.845737 26996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:37587 every 8 connection(s)
I20260810 03:45:24.846659 26922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:24.847394 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 26922
I20260810 03:45:24.847522 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:24.847810 23067 external_mini_cluster.cc:1428] Setting key a0d7d50f30dcf79b8232bed25fc02020
I20260810 03:45:24.849833 26997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:24.857077 26997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d: Bootstrap starting.
Aug 10 03:45:24 dist-test-slave-qg60 krb5kdc[26907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:24.859817 26997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:24.860710 26997 log.cc:824] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:24.863117 26997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d: No bootstrap required, opened a new log
I20260810 03:45:24.863154 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:24.849274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45746 (local address 127.22.134.254:37587)
0810 03:45:24.849697 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:24.849718 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:24.849759 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:45:24.850586 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:24.850609 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:24.851020 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:24.851394 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:24.852223 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:24.853771 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:24.854611 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:24.855336 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:24.855501 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:24.858330 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:24.858336 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:24.858348 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:24.858377 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:24.860090 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:24.860583 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:24.860588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:24.860592 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:24.860700 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:24.861014 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:24.861016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:24.861017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:24.861430 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:24.861572 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:24.861933 (+ 361us) server_negotiation.cc:299] Negotiation successful
0810 03:45:24.862233 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":118,"threads_started":1}
I20260810 03:45:24.866930 26997 raft_consensus.cc:348] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "773840dddbb14cbc8fadf98840f3672d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37587 } }
I20260810 03:45:24.867151 26997 raft_consensus.cc:374] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:24.867190 26997 raft_consensus.cc:729] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773840dddbb14cbc8fadf98840f3672d, State: Initialized, Role: FOLLOWER
I20260810 03:45:24.867604 26997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "773840dddbb14cbc8fadf98840f3672d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37587 } }
I20260810 03:45:24.867733 26997 raft_consensus.cc:388] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:24.867780 26997 raft_consensus.cc:482] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:24.867852 26997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:24.868790 26997 raft_consensus.cc:504] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "773840dddbb14cbc8fadf98840f3672d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37587 } }
I20260810 03:45:24.869117 26997 leader_election.cc:302] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 773840dddbb14cbc8fadf98840f3672d; no voters:
I20260810 03:45:24.869386 26997 leader_election.cc:288] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:24.869586 27003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:24.869843 27003 raft_consensus.cc:686] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [term 1 LEADER]: Becoming Leader. State: Replica: 773840dddbb14cbc8fadf98840f3672d, State: Running, Role: LEADER
I20260810 03:45:24.870188 27003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "773840dddbb14cbc8fadf98840f3672d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37587 } }
I20260810 03:45:24.870716 26997 sys_catalog.cc:564] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:24.872129 27004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "773840dddbb14cbc8fadf98840f3672d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "773840dddbb14cbc8fadf98840f3672d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37587 } } }
I20260810 03:45:24.872278 27004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:24.872572 27005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 773840dddbb14cbc8fadf98840f3672d. Latest consensus state: current_term: 1 leader_uuid: "773840dddbb14cbc8fadf98840f3672d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "773840dddbb14cbc8fadf98840f3672d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37587 } } }
I20260810 03:45:24.872681 27005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:24.872816 27014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:24.876282 27014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:24.881980 27014 catalog_manager.cc:1347] Generated new cluster ID: 7a8372e254fa41e69bb415736aa4f1a9
I20260810 03:45:24.882064 27014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:24.891579 27014 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:24.892875 27014 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:24.901060 27014 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 773840dddbb14cbc8fadf98840f3672d: Generated new TSK 0
I20260810 03:45:24.901880 27014 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:24.935340 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37587
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:25.050531 27026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:25.050827 27026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:25.050905 27026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:25.055248 27026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:25.055322 27026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:25.055413 27026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:25.060937 27026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:25.062144 27026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:25.063189 27026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:45:25.073433 27026 server_base.cc:1034] running on GCE node
W20260810 03:45:25.073380 27036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:25.073449 27034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:25.073380 27033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:25.074055 27026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:25.074749 27026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:25.075943 27026 hybrid_clock.cc:648] HybridClock initialized: now 1786333525075911 us; error 46 us; skew 500 ppm
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:25.079066 27026 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:25.079939 27026 webserver.cc:460] Webserver started at http://127.22.134.193:40879/ using document root <none> and password file <none>
I20260810 03:45:25.080470 27026 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:25.080529 27026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:25.080711 27026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:25.082897 27026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "adc66f01ed8744dc9f0ae1d9bfddc3d7"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "165478b6a5966d069073abb32cd6e945"
server_key_iv: "1101e19daf6bbc1ec65cd2febf0faecb"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.083407 27026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "adc66f01ed8744dc9f0ae1d9bfddc3d7"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "165478b6a5966d069073abb32cd6e945"
server_key_iv: "1101e19daf6bbc1ec65cd2febf0faecb"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.087200 27026 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:25.089728 27045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.091094 27026 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 03:45:25.091240 27026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "adc66f01ed8744dc9f0ae1d9bfddc3d7"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "165478b6a5966d069073abb32cd6e945"
server_key_iv: "1101e19daf6bbc1ec65cd2febf0faecb"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.091377 27026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:25.103997 27026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:25.107357 27026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:25.107574 27026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:25.108175 27026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:25.109236 27026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:25.109297 27026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.109362 27026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:25.109396 27026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.118371 27026 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:46169
I20260810 03:45:25.118404 27166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:46169 every 8 connection(s)
I20260810 03:45:25.119287 27026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:25.122682 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 27026
I20260810 03:45:25.122843 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:25.123229 23067 external_mini_cluster.cc:1428] Setting key 3c7e529c8fbc472cba59819906fcc36f
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:25.134634 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:25.121235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:60017 (local address 127.22.134.254:37587)
0810 03:45:25.121406 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:25.121411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:25.122225 (+ 814us) server_negotiation.cc:407] Connection header received
0810 03:45:25.123947 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:25.123950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:25.124009 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:25.124080 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:25.125577 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.126118 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.127512 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.127920 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.128042 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:25.130586 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:25.130592 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:25.130597 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:25.130633 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:25.132418 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.132987 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.132994 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.132997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.133096 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.133444 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.133450 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.133454 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.133732 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:25.133833 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:25.134389 (+ 556us) server_negotiation.cc:299] Negotiation successful
0810 03:45:25.134504 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:45:25.135546 27172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:25.121632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37587 (local address 127.22.134.193:60017)
0810 03:45:25.122070 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:25.122114 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:25.123754 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:25.124248 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:25.124257 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:25.124699 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:25.125421 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:25.125443 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.126243 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.126250 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:25.127388 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:25.127397 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.128073 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.128076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:25.128212 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:25.128851 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:25.128867 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:25.130410 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:25.132536 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:25.132540 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:25.132553 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:25.132887 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:25.133194 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:25.133196 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:25.133198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:25.133326 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:25.133832 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:25.133837 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:25.134099 (+ 262us) client_negotiation.cc:769] Sending connection context
0810 03:45:25.134284 (+ 185us) client_negotiation.cc:240] Negotiation successful
0810 03:45:25.134549 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":106,"threads_started":1}
I20260810 03:45:25.136943 27169 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37587
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:45:25.137195 27169 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:25.137794 27169 heartbeater.cc:511] Master 127.22.134.254:37587 requested a full tablet report, sending...
I20260810 03:45:25.139518 26957 ts_manager.cc:194] Registered new tserver with Master: adc66f01ed8744dc9f0ae1d9bfddc3d7 (127.22.134.193:46169)
I20260810 03:45:25.140684 26957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:60017
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:25.157212 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37587
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:25.273113 27177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:25.273386 27177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:25.273453 27177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:25.277850 27177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:25.277926 27177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:25.278064 27177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:25.283936 27177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:25.285166 27177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:25.286279 27177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:25.296465 27183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:25.296470 27182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:25.296470 27185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:25.296718 27177 server_base.cc:1034] running on GCE node
I20260810 03:45:25.297360 27177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:25.298077 27177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:25.299260 27177 hybrid_clock.cc:648] HybridClock initialized: now 1786333525299241 us; error 33 us; skew 500 ppm
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:25.302309 27177 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:25.303238 27177 webserver.cc:460] Webserver started at http://127.22.134.194:34647/ using document root <none> and password file <none>
I20260810 03:45:25.303880 27177 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:25.303944 27177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:25.304185 27177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:25.306311 27177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "fa836e6f23c1458e8fb3ea10eee0f2fe"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "b0fd9427fbf71358f5fe25a23c0e81a3"
server_key_iv: "f2d54871a0bcb15445c50d9e4d91757b"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.306886 27177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "fa836e6f23c1458e8fb3ea10eee0f2fe"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "b0fd9427fbf71358f5fe25a23c0e81a3"
server_key_iv: "f2d54871a0bcb15445c50d9e4d91757b"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.310971 27177 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260810 03:45:25.313665 27192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.315021 27177 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:25.315145 27177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "fa836e6f23c1458e8fb3ea10eee0f2fe"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "b0fd9427fbf71358f5fe25a23c0e81a3"
server_key_iv: "f2d54871a0bcb15445c50d9e4d91757b"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.315269 27177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:25.325902 27177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:25.329232 27177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:25.329438 27177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:25.330042 27177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:25.330876 27177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:25.330924 27177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.330992 27177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:25.331030 27177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.339862 27177 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:33791
I20260810 03:45:25.339936 27312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:33791 every 8 connection(s)
I20260810 03:45:25.340904 27177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:25.344704 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 27177
I20260810 03:45:25.344897 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:25.345187 23067 external_mini_cluster.cc:1428] Setting key 9ad7be0dd1dd3972dfd40f881624ab89
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:45:25.355577 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:25.342727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:44365 (local address 127.22.134.254:37587)
0810 03:45:25.342860 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:25.342863 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:25.343641 (+ 778us) server_negotiation.cc:407] Connection header received
0810 03:45:25.345289 (+ 1648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:25.345292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:25.345386 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:25.345501 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:25.346839 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.347351 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.348610 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.348906 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.349114 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:25.351910 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:25.351914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:25.351916 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:25.351946 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:25.353478 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.353991 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.353995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.353997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.354080 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.354432 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.354437 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.354438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.354624 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:25.354735 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:25.355280 (+ 545us) server_negotiation.cc:299] Negotiation successful
0810 03:45:25.355428 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:45:25.356387 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:25.343039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37587 (local address 127.22.134.194:44365)
0810 03:45:25.343487 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:25.343532 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:25.345009 (+ 1477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:25.345681 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:25.345687 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:25.346139 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:25.346703 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:25.346718 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.347473 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.347477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:25.348384 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:25.348394 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.349163 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.349167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:25.349359 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:25.350005 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:25.350021 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:25.351743 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:25.353597 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:25.353604 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:25.353620 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:25.353884 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:25.354181 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:25.354186 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:25.354191 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:25.354335 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:25.354731 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:25.354738 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:25.354994 (+ 256us) client_negotiation.cc:769] Sending connection context
0810 03:45:25.355196 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 03:45:25.355483 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":112,"threads_started":1}
I20260810 03:45:25.357678 27313 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37587
I20260810 03:45:25.358016 27313 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
I20260810 03:45:25.358654 27313 heartbeater.cc:511] Master 127.22.134.254:37587 requested a full tablet report, sending...
I20260810 03:45:25.359845 26957 ts_manager.cc:194] Registered new tserver with Master: fa836e6f23c1458e8fb3ea10eee0f2fe (127.22.134.194:33791)
I20260810 03:45:25.360445 26957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:44365
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:25.376633 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37587
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:25.501025 27322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:25.501360 27322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:25.501407 27322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:25.506139 27322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:25.506219 27322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:25.506287 27322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:25.513290 27322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:25.514724 27322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:25.516083 27322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:25.526618 27328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:25.526654 27327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:25.526598 27330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:25.526855 27322 server_base.cc:1034] running on GCE node
I20260810 03:45:25.527386 27322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:25.528807 27322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:25.529975 27322 hybrid_clock.cc:648] HybridClock initialized: now 1786333525529935 us; error 55 us; skew 500 ppm
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:25.533131 27322 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:25.534286 27322 webserver.cc:460] Webserver started at http://127.22.134.195:44597/ using document root <none> and password file <none>
I20260810 03:45:25.535019 27322 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:25.535097 27322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:25.535365 27322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:25.537997 27322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "daf09c6988cd4bf7a9c6af606f7af118"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "3b0bc4e4bb926819d0e0de3542e3018e"
server_key_iv: "85fcc7f98a45c5dc28681966311d5c93"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.538595 27322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "daf09c6988cd4bf7a9c6af606f7af118"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "3b0bc4e4bb926819d0e0de3542e3018e"
server_key_iv: "85fcc7f98a45c5dc28681966311d5c93"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.543022 27322 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:25.546600 27338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.548369 27322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:45:25.548524 27322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "daf09c6988cd4bf7a9c6af606f7af118"
format_stamp: "Formatted at 2026-08-10 03:45:25 on dist-test-slave-qg60"
server_key: "3b0bc4e4bb926819d0e0de3542e3018e"
server_key_iv: "85fcc7f98a45c5dc28681966311d5c93"
server_key_version: "encryptionkey@0"
I20260810 03:45:25.548671 27322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:25.571347 27322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:25.575141 27322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:25.575368 27322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:25.576009 27322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:25.576959 27322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:25.577039 27322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.577127 27322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:25.577174 27322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:25.586714 27322 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:44869
I20260810 03:45:25.586738 27460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:44869 every 8 connection(s)
I20260810 03:45:25.587697 27322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:25.595655 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 27322
I20260810 03:45:25.595827 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:25.596154 23067 external_mini_cluster.cc:1428] Setting key 1121eece91b84233facaf41f68c92ba4
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:25.603441 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:25.589689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:44235 (local address 127.22.134.254:37587)
0810 03:45:25.589856 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:25.589861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:25.590830 (+ 969us) server_negotiation.cc:407] Connection header received
0810 03:45:25.592313 (+ 1483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:25.592316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:25.592365 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:25.592443 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:25.593846 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.594418 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.595855 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.596174 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.596282 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:25.599521 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:25.599528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:25.599534 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:25.599570 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:25.601319 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.601844 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.601851 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.601856 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.601953 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.602308 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.602314 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.602319 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.602535 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:25.602616 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:25.603107 (+ 491us) server_negotiation.cc:299] Negotiation successful
0810 03:45:25.603306 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:45:25.604283 27463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:25.590101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37587 (local address 127.22.134.195:44235)
0810 03:45:25.590610 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:25.590657 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:25.592094 (+ 1437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:25.592694 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:25.592702 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:25.593170 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:25.593704 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:25.593718 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.594538 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.594541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:25.595654 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:25.595664 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.596356 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.596360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:25.596539 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:25.597339 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:25.597360 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:25.599338 (+ 1978us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:25.601441 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:25.601447 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:25.601462 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:25.601745 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:25.602045 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:25.602047 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:25.602049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:25.602214 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:25.602626 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:25.602631 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:25.602892 (+ 261us) client_negotiation.cc:769] Sending connection context
0810 03:45:25.603057 (+ 165us) client_negotiation.cc:240] Negotiation successful
0810 03:45:25.603343 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":119,"threads_started":1}
I20260810 03:45:25.605551 27461 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37587
I20260810 03:45:25.605777 27461 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:25.606285 27461 heartbeater.cc:511] Master 127.22.134.254:37587 requested a full tablet report, sending...
I20260810 03:45:25.607882 26957 ts_manager.cc:194] Registered new tserver with Master: daf09c6988cd4bf7a9c6af606f7af118 (127.22.134.195:44869)
I20260810 03:45:25.608469 26957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:44235
I20260810 03:45:25.610741 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:25.711483 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:25.700828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47300 (local address 127.22.134.193:46169)
0810 03:45:25.701090 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:25.701104 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:25.701132 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:45:25.701205 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:25.701210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:25.701408 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:25.701531 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:25.702515 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.703278 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.704177 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.704549 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.704645 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:25.707635 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:25.707645 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:25.707659 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:25.707714 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:25.709544 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.710024 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.710029 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.710030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.710109 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.710434 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.710437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.710438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.710691 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:25.710853 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:25.711102 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 03:45:25.711278 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":70,"threads_started":1}
Aug 10 03:45:25 dist-test-slave-qg60 krb5kdc[26907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:25.722904 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:25.714576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45760 (local address 127.22.134.254:37587)
0810 03:45:25.714743 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:25.714746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:25.714762 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:45:25.714835 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:25.714837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:25.714878 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:25.714947 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:25.715544 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.716087 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.716923 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:25.717136 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:25.717225 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:25.719718 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:25.719722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:25.719724 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:25.719749 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:25.721203 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.721579 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.721582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.721583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.721657 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:25.721942 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:25.721944 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:25.721945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:25.722171 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:25.722319 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:25.722582 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 03:45:25.722729 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 03:45:25.723361 26957 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45760
I20260810 03:45:25.724032 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 27026
I20260810 03:45:25.730980 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 27177
I20260810 03:45:25.739084 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 27322
I20260810 03:45:25.746438 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 26922
2026-08-10T03:45:25Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2351 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:27 dist-test-slave-qg60 krb5kdc[27476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:27 dist-test-slave-qg60 krb5kdc[27476](info): set up 2 sockets
Aug 10 03:45:27 dist-test-slave-qg60 krb5kdc[27476](info): commencing operation
krb5kdc: starting...
W20260810 03:45:28.269768 23067 mini_kdc.cc:121] Time spent starting KDC: real 2.497s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:28 dist-test-slave-qg60 krb5kdc[27476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:28.409451 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:34623
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:34427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:34623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:28.524652 27490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:28.524976 27490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:28.525022 27490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:28.529239 27490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:28.529312 27490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:28.529332 27490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:28.529350 27490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:28.529364 27490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:28.534912 27490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:34623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:34623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:28.536085 27490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:28.537199 27490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:28.546844 27497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:28.546844 27499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:28.546844 27496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:28.547297 27490 server_base.cc:1034] running on GCE node
I20260810 03:45:28.547933 27490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:28.549266 27490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:28.550483 27490 hybrid_clock.cc:648] HybridClock initialized: now 1786333528550468 us; error 33 us; skew 500 ppm
Aug 10 03:45:28 dist-test-slave-qg60 krb5kdc[27476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333528, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:28.558781 27490 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:28.559563 27490 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:28.559635 27490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:28.559808 27490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:28.562119 27490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608"
format_stamp: "Formatted at 2026-08-10 03:45:28 on dist-test-slave-qg60"
server_key: "06eb09befeeca21ab23eaebb1d0ab3a6"
server_key_iv: "e60b3a3c919f8aa29018a4a633751f65"
server_key_version: "encryptionkey@0"
I20260810 03:45:28.562650 27490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608"
format_stamp: "Formatted at 2026-08-10 03:45:28 on dist-test-slave-qg60"
server_key: "06eb09befeeca21ab23eaebb1d0ab3a6"
server_key_iv: "e60b3a3c919f8aa29018a4a633751f65"
server_key_version: "encryptionkey@0"
I20260810 03:45:28.566454 27490 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:28.568842 27505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:28.570154 27490 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:28.570273 27490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608"
format_stamp: "Formatted at 2026-08-10 03:45:28 on dist-test-slave-qg60"
server_key: "06eb09befeeca21ab23eaebb1d0ab3a6"
server_key_iv: "e60b3a3c919f8aa29018a4a633751f65"
server_key_version: "encryptionkey@0"
I20260810 03:45:28.570365 27490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:28.603021 27490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:28.606487 27490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:28.606668 27490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:28.614022 27490 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:34623
I20260810 03:45:28.614333 27559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:34623 every 8 connection(s)
I20260810 03:45:28.614735 27490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:28.617174 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 27490
I20260810 03:45:28.617293 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:28.617601 23067 external_mini_cluster.cc:1428] Setting key 2cc12394d4c68830981484913720998c
I20260810 03:45:28.617738 27562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:28.624635 27562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608: Bootstrap starting.
I20260810 03:45:28.627349 27562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608: Neither blocks nor log segments found. Creating new log.
Aug 10 03:45:28 dist-test-slave-qg60 krb5kdc[27476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:28.628326 27562 log.cc:824] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:28.630822 27562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608: No bootstrap required, opened a new log
I20260810 03:45:28.633407 27566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:28.619092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58854 (local address 127.22.134.254:34623)
0810 03:45:28.619546 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:28.619560 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:28.619599 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:45:28.620522 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:28.620541 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:28.620936 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:28.621275 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:28.622124 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:28.623176 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:28.624419 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:28.625177 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:28.625357 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:28.628262 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:28.628268 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:28.628283 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:28.628316 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:28.630311 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:28.630833 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:28.630838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:28.630842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:28.631005 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:28.631317 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:28.631319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:28.631320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:28.631715 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:28.631863 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:28.632248 (+ 385us) server_negotiation.cc:299] Negotiation successful
0810 03:45:28.632578 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":145,"threads_started":1}
I20260810 03:45:28.635033 27562 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34623 } }
I20260810 03:45:28.635306 27562 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:28.635356 27562 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4545e5d9b6a4eb2931b2c2a5e64d608, State: Initialized, Role: FOLLOWER
I20260810 03:45:28.635780 27562 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34623 } }
I20260810 03:45:28.635952 27562 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:28.636032 27562 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:28.636155 27562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:28.637164 27562 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34623 } }
I20260810 03:45:28.637534 27562 leader_election.cc:302] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4545e5d9b6a4eb2931b2c2a5e64d608; no voters:
I20260810 03:45:28.637907 27562 leader_election.cc:288] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:28.637969 27568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:28.638254 27568 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [term 1 LEADER]: Becoming Leader. State: Replica: c4545e5d9b6a4eb2931b2c2a5e64d608, State: Running, Role: LEADER
I20260810 03:45:28.638608 27568 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34623 } }
I20260810 03:45:28.639151 27562 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:28.640295 27570 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4545e5d9b6a4eb2931b2c2a5e64d608. Latest consensus state: current_term: 1 leader_uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34623 } } }
I20260810 03:45:28.640426 27570 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:28.640790 27569 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4545e5d9b6a4eb2931b2c2a5e64d608" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34623 } } }
I20260810 03:45:28.640970 27569 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:28.640867 27578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:28.644296 27578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:28.649763 27578 catalog_manager.cc:1347] Generated new cluster ID: ea2409d226df45be8c1065fc215f3aac
I20260810 03:45:28.649849 27578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:28.672328 27578 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:28.673431 27578 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:28.679529 27578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608: Generated new TSK 0
I20260810 03:45:28.680321 27578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:28.720439 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34623
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:34427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:28.847353 27591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:28.847656 27591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:28.847704 27591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:28.851912 27591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:28.851994 27591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:28.852110 27591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:28.857683 27591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:28.858865 27591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:28.859938 27591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:28.869670 27600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:28.869673 27598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:28.869673 27597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:28.869993 27591 server_base.cc:1034] running on GCE node
I20260810 03:45:28.870529 27591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:28.871254 27591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:28.872445 27591 hybrid_clock.cc:648] HybridClock initialized: now 1786333528872433 us; error 34 us; skew 500 ppm
Aug 10 03:45:28 dist-test-slave-qg60 krb5kdc[27476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333528, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:28.875597 27591 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:28.876397 27591 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:28.876497 27591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:28.876780 27591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:28.878981 27591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "e0e365e0f56248c792cba89ab5542507"
format_stamp: "Formatted at 2026-08-10 03:45:28 on dist-test-slave-qg60"
server_key: "5a8416f6422a0f73e7275e583e22bdd9"
server_key_iv: "b0d785b13e1d02f377a4fe83b1d49204"
server_key_version: "encryptionkey@0"
I20260810 03:45:28.879567 27591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "e0e365e0f56248c792cba89ab5542507"
format_stamp: "Formatted at 2026-08-10 03:45:28 on dist-test-slave-qg60"
server_key: "5a8416f6422a0f73e7275e583e22bdd9"
server_key_iv: "b0d785b13e1d02f377a4fe83b1d49204"
server_key_version: "encryptionkey@0"
I20260810 03:45:28.883419 27591 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:28.885862 27606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:28.887128 27591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:28.887272 27591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "e0e365e0f56248c792cba89ab5542507"
format_stamp: "Formatted at 2026-08-10 03:45:28 on dist-test-slave-qg60"
server_key: "5a8416f6422a0f73e7275e583e22bdd9"
server_key_iv: "b0d785b13e1d02f377a4fe83b1d49204"
server_key_version: "encryptionkey@0"
I20260810 03:45:28.887387 27591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:28.922677 27591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:28.925875 27591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:28.926105 27591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:28.926724 27591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:28.927646 27591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:28.927718 27591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:28.927791 27591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:28.927842 27591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:28.937014 27591 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:42423
I20260810 03:45:28.937044 27730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:42423 every 8 connection(s)
I20260810 03:45:28.937654 27591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:28.939016 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 27591
I20260810 03:45:28.939149 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:28.939440 23067 external_mini_cluster.cc:1428] Setting key 70ae3cdc68002559cd0d7472140897f3
Aug 10 03:45:28 dist-test-slave-qg60 krb5kdc[27476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333528, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:45:28.953265 27566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:28.939897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:37563 (local address 127.22.134.254:34623)
0810 03:45:28.940083 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:28.940088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:28.941620 (+ 1532us) server_negotiation.cc:407] Connection header received
0810 03:45:28.942487 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:28.942494 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:28.942559 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:28.942654 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:28.943926 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:28.944478 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:28.945759 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:28.946013 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:28.946141 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:28.949306 (+ 3165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:28.949309 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:28.949311 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:28.949336 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:28.950909 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:28.951529 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:28.951532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:28.951533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:28.951613 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:28.951996 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:28.951999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:28.952001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:28.952197 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:28.952306 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:28.952949 (+ 643us) server_negotiation.cc:299] Negotiation successful
0810 03:45:28.953095 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 03:45:28.954558 27734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:28.940232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:34623 (local address 127.22.134.193:37563)
0810 03:45:28.941471 (+ 1239us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:28.941518 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:28.942284 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:28.942837 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:28.942844 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:28.943251 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:28.943768 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:28.943781 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:28.944634 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:28.944640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:28.945614 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:28.945625 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:28.946195 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:28.946199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:28.946378 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:28.947162 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:28.947180 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:28.949033 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:28.951039 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:28.951045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:28.951105 (+ 60us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:28.951404 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:28.951736 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:28.951740 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:28.951742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:28.951893 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:28.952340 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:28.952347 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:28.952643 (+ 296us) client_negotiation.cc:769] Sending connection context
0810 03:45:28.952889 (+ 246us) client_negotiation.cc:240] Negotiation successful
0810 03:45:28.953315 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":144,"threads_started":1}
I20260810 03:45:28.955996 27732 heartbeater.cc:347] Connected to a master server at 127.22.134.254:34623
I20260810 03:45:28.956292 27732 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:28.956916 27732 heartbeater.cc:511] Master 127.22.134.254:34623 requested a full tablet report, sending...
I20260810 03:45:28.958739 27523 ts_manager.cc:194] Registered new tserver with Master: e0e365e0f56248c792cba89ab5542507 (127.22.134.193:42423)
I20260810 03:45:28.960585 27523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:37563
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:28.973588 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34623
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:34427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:29.094015 27737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:29.094301 27737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:29.094379 27737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:29.098450 27737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:29.098512 27737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:29.098618 27737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:29.104060 27737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:29.105157 27737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:29.106220 27737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:29.115938 27743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:29.115931 27744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:29.116019 27737 server_base.cc:1034] running on GCE node
W20260810 03:45:29.115926 27747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:29.116655 27737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:29.117359 27737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:29.118559 27737 hybrid_clock.cc:648] HybridClock initialized: now 1786333529118537 us; error 46 us; skew 500 ppm
Aug 10 03:45:29 dist-test-slave-qg60 krb5kdc[27476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333529, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:29.121490 27737 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:29.122257 27737 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:29.122354 27737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:29.122591 27737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:29.124619 27737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "5eb7b602248243ffb05590cacf5a984e"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "0fe0647f1c0a338e6a71d348334030dd"
server_key_iv: "c6f3803d372d362bc1a3241d18b7b0dc"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.125249 27737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "5eb7b602248243ffb05590cacf5a984e"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "0fe0647f1c0a338e6a71d348334030dd"
server_key_iv: "c6f3803d372d362bc1a3241d18b7b0dc"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.129060 27737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:45:29.131594 27753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:29.133030 27737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:29.133175 27737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "5eb7b602248243ffb05590cacf5a984e"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "0fe0647f1c0a338e6a71d348334030dd"
server_key_iv: "c6f3803d372d362bc1a3241d18b7b0dc"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.133298 27737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:29.149200 27737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:29.152318 27737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:29.152535 27737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:29.153185 27737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:29.154078 27737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:29.154134 27737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:29.154189 27737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:29.154217 27737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:29.163810 27737 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:32981
I20260810 03:45:29.163836 27883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:32981 every 8 connection(s)
I20260810 03:45:29.164428 27737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:29.171890 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 27737
I20260810 03:45:29.172041 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:29.172362 23067 external_mini_cluster.cc:1428] Setting key 25ca4e55362019a4405bf962196a1af7
Aug 10 03:45:29 dist-test-slave-qg60 krb5kdc[27476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333529, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:29.179256 27566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.166276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:46687 (local address 127.22.134.254:34623)
0810 03:45:29.166436 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.166441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.167700 (+ 1259us) server_negotiation.cc:407] Connection header received
0810 03:45:29.168642 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.168645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.168696 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.168828 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:29.170018 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.170602 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.171785 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.172045 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.172150 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.175091 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:29.175099 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:29.175101 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:29.175125 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:29.176989 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:29.177537 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:29.177543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:29.177547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:29.177655 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:29.177982 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:29.177988 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:29.177993 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:29.178274 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:29.178386 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.178906 (+ 520us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.179043 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:29.180182 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.166721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:34623 (local address 127.22.134.194:46687)
0810 03:45:29.167545 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:29.167588 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:29.168443 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:29.169012 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:29.169018 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:29.169384 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:29.169868 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.169881 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.170744 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.170747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.171622 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.171631 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.172198 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.172202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.172369 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.173131 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:29.173155 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:29.174903 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:29.177108 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:29.177114 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:29.177127 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:29.177404 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:29.177752 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:29.177754 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:29.177755 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:29.177887 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:29.178379 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:29.178384 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:29.178622 (+ 238us) client_negotiation.cc:769] Sending connection context
0810 03:45:29.178856 (+ 234us) client_negotiation.cc:240] Negotiation successful
0810 03:45:29.179193 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":118,"threads_started":1}
I20260810 03:45:29.181530 27884 heartbeater.cc:347] Connected to a master server at 127.22.134.254:34623
I20260810 03:45:29.181813 27884 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:29.182395 27884 heartbeater.cc:511] Master 127.22.134.254:34623 requested a full tablet report, sending...
I20260810 03:45:29.183689 27523 ts_manager.cc:194] Registered new tserver with Master: 5eb7b602248243ffb05590cacf5a984e (127.22.134.194:32981)
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:45:29.184351 27523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:46687
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:29.204360 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34623
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:34427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:29.324084 27890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:29.324368 27890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:29.324417 27890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:29.328902 27890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:29.328987 27890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:29.329115 27890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:29.335098 27890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:29.336277 27890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:29.337664 27890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:29.348352 27899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:29.348368 27896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:29.348368 27897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:29.348788 27890 server_base.cc:1034] running on GCE node
I20260810 03:45:29.349398 27890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:29.350069 27890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:29.351264 27890 hybrid_clock.cc:648] HybridClock initialized: now 1786333529351252 us; error 35 us; skew 500 ppm
Aug 10 03:45:29 dist-test-slave-qg60 krb5kdc[27476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333529, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:29.354221 27890 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:29.354984 27890 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:29.355082 27890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:29.355326 27890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:29.357451 27890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "ade29c152e48ab131b8baf4324a05ec3"
server_key_iv: "f87a94416aa22bae14acc88529c06ac3"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.358032 27890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "ade29c152e48ab131b8baf4324a05ec3"
server_key_iv: "f87a94416aa22bae14acc88529c06ac3"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.361790 27890 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:45:29.364300 27907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:29.365586 27890 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:29.365739 27890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "ade29c152e48ab131b8baf4324a05ec3"
server_key_iv: "f87a94416aa22bae14acc88529c06ac3"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.365857 27890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:29.390461 27890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:29.394414 27890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:29.394662 27890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:29.395335 27890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:29.396288 27890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:29.396368 27890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:29.396449 27890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:29.396512 27890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:29.406363 27890 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:45037
I20260810 03:45:29.406386 28028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:45037 every 8 connection(s)
I20260810 03:45:29.407013 27890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:29.412470 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 27890
I20260810 03:45:29.412637 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:29.412966 23067 external_mini_cluster.cc:1428] Setting key 87c8b63f0462813931a185690e8a74e9
Aug 10 03:45:29 dist-test-slave-qg60 krb5kdc[27476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333529, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:29.421290 27566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.408932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:40469 (local address 127.22.134.254:34623)
0810 03:45:29.409113 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.409119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.410346 (+ 1227us) server_negotiation.cc:407] Connection header received
0810 03:45:29.411221 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.411224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.411273 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.411357 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:29.412548 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.413245 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.414562 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.414873 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.414979 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.417771 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:29.417774 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:29.417777 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:29.417812 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:29.419030 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:29.419563 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:29.419567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:29.419569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:29.419655 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:29.420002 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:29.420006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:29.420008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:29.420206 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:29.420313 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.420912 (+ 599us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.421040 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 03:45:29.422081 28033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.409368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:34623 (local address 127.22.134.195:40469)
0810 03:45:29.410199 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:29.410240 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:29.411010 (+ 770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:29.411515 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:29.411521 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:29.411912 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:29.412386 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.412398 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.413408 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.413411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.414450 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.414460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.415023 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.415025 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.415271 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.415938 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:29.415954 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:29.417572 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:29.419163 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:29.419168 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:29.419184 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:29.419446 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:29.419749 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:29.419753 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:29.419755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:29.419904 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:29.420325 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:29.420333 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:29.420607 (+ 274us) client_negotiation.cc:769] Sending connection context
0810 03:45:29.420858 (+ 251us) client_negotiation.cc:240] Negotiation successful
0810 03:45:29.421214 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":121,"threads_started":1}
I20260810 03:45:29.423192 28029 heartbeater.cc:347] Connected to a master server at 127.22.134.254:34623
I20260810 03:45:29.423404 28029 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:29.423825 28029 heartbeater.cc:511] Master 127.22.134.254:34623 requested a full tablet report, sending...
I20260810 03:45:29.424880 27523 ts_manager.cc:194] Registered new tserver with Master: 09590d33e1ac4dc19b3bd7ec579c4e5f (127.22.134.195:45037)
I20260810 03:45:29.425418 27523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:40469
I20260810 03:45:29.427189 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:45:29.436281 27566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.429213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58868 (local address 127.22.134.254:34623)
0810 03:45:29.429332 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.429335 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.429568 (+ 233us) server_negotiation.cc:407] Connection header received
0810 03:45:29.429649 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.429652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.429691 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.429758 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:29.430462 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.430966 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.431798 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.431997 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.432074 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.433568 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:29.433570 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:29.433572 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:29.433592 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:29.434832 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:29.435262 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:29.435264 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:29.435266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:29.435340 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:29.435560 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:29.435562 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:29.435563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:29.435771 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:29.435876 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.436059 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.436162 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:45:29.439489 27523 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:29.442919 27523 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:29.457636 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.451889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59872 (local address 127.22.134.193:42423)
0810 03:45:29.452348 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.452357 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.452905 (+ 548us) server_negotiation.cc:407] Connection header received
0810 03:45:29.453236 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.453242 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.453444 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.453575 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:29.454024 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.454768 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.456289 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.456920 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.457062 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.457201 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.457375 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.457468 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":176,"threads_started":1}
I20260810 03:45:29.457636 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.451635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42423 (local address 127.0.0.1:59872)
0810 03:45:29.452763 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:29.452818 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:29.453022 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:29.453785 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:29.453787 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:29.453802 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:29.453911 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.453915 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.454908 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.454911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.456167 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.456176 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.457051 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.457055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.457161 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.457197 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:45:29.457339 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 03:45:29.457467 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1006,"mutex_wait_us":123,"thread_start_us":129,"threads_started":1}
I20260810 03:45:29.458649 28048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.451635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:45037 (local address 127.0.0.1:39872)
0810 03:45:29.452764 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:29.452818 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:29.453020 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:29.453740 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:29.453743 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:29.453756 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:29.453911 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.453918 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.455399 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.455402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.456906 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.456917 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.458171 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.458186 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.458309 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.458369 (+ 60us) client_negotiation.cc:769] Sending connection context
0810 03:45:29.458444 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 03:45:29.458519 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"mutex_wait_us":215,"thread_start_us":96,"threads_started":1}
I20260810 03:45:29.458767 28049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.452472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42500 (local address 127.22.134.194:32981)
0810 03:45:29.452935 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.452947 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.453185 (+ 238us) server_negotiation.cc:407] Connection header received
0810 03:45:29.453265 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.453270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.453444 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.453594 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:29.454052 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.455240 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.457053 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.457860 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.457958 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.458067 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.458508 (+ 441us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.458601 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":136,"threads_started":1}
I20260810 03:45:29.459060 28046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.451760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39872 (local address 127.22.134.195:45037)
0810 03:45:29.452564 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.452577 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.452906 (+ 329us) server_negotiation.cc:407] Connection header received
0810 03:45:29.453225 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.453231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.453418 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.453516 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:29.454044 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.455240 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.457053 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.457860 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.457958 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.458066 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.458808 (+ 742us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.458903 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":109,"threads_started":1}
I20260810 03:45:29.459177 28044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.452276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32981 (local address 127.0.0.1:42500)
0810 03:45:29.453074 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:29.453089 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:29.453179 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:29.453627 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:29.453634 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:29.453658 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:29.453913 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.453918 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.455400 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.455402 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.456906 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.456917 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.458171 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.458174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.458334 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.458379 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 03:45:29.458968 (+ 589us) client_negotiation.cc:240] Negotiation successful
0810 03:45:29.459040 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":283,"thread_start_us":94,"threads_started":1}
I20260810 03:45:29.461383 27660 tablet_service.cc:1467] Processing CreateTablet for tablet 722210edd6c74ae8b55685e0ff7c215c (DEFAULT_TABLE table=test-table [id=9c956533e1024c1094ae72794e988d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:29.461750 27959 tablet_service.cc:1467] Processing CreateTablet for tablet 722210edd6c74ae8b55685e0ff7c215c (DEFAULT_TABLE table=test-table [id=9c956533e1024c1094ae72794e988d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:29.462615 27660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 722210edd6c74ae8b55685e0ff7c215c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:29.462706 27959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 722210edd6c74ae8b55685e0ff7c215c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:29.466384 27806 tablet_service.cc:1467] Processing CreateTablet for tablet 722210edd6c74ae8b55685e0ff7c215c (DEFAULT_TABLE table=test-table [id=9c956533e1024c1094ae72794e988d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:29.467476 27806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 722210edd6c74ae8b55685e0ff7c215c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:29.470376 28050 tablet_bootstrap.cc:492] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507: Bootstrap starting.
I20260810 03:45:29.471720 28051 tablet_bootstrap.cc:492] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Bootstrap starting.
I20260810 03:45:29.473351 28050 tablet_bootstrap.cc:654] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:29.473796 28051 tablet_bootstrap.cc:654] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:29.474294 28050 log.cc:824] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:29.475016 28052 tablet_bootstrap.cc:492] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Bootstrap starting.
I20260810 03:45:29.475049 28051 log.cc:824] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:29.476397 28050 tablet_bootstrap.cc:492] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507: No bootstrap required, opened a new log
I20260810 03:45:29.476632 28050 ts_tablet_manager.cc:1397] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:45:29.477207 28051 tablet_bootstrap.cc:492] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: No bootstrap required, opened a new log
I20260810 03:45:29.477224 28052 tablet_bootstrap.cc:654] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:29.477416 28051 ts_tablet_manager.cc:1397] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:45:29.478340 28052 log.cc:824] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:29.480396 28052 tablet_bootstrap.cc:492] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: No bootstrap required, opened a new log
I20260810 03:45:29.480584 28052 ts_tablet_manager.cc:1397] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:45:29.480806 28050 raft_consensus.cc:348] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.481045 28050 raft_consensus.cc:374] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:29.481112 28050 raft_consensus.cc:729] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0e365e0f56248c792cba89ab5542507, State: Initialized, Role: FOLLOWER
I20260810 03:45:29.481163 28051 raft_consensus.cc:348] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.481426 28051 raft_consensus.cc:374] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:29.481498 28051 raft_consensus.cc:729] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09590d33e1ac4dc19b3bd7ec579c4e5f, State: Initialized, Role: FOLLOWER
I20260810 03:45:29.481643 28050 consensus_queue.cc:260] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.481899 28051 consensus_queue.cc:260] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.482429 27732 heartbeater.cc:503] Master 127.22.134.254:34623 was elected leader, sending a full tablet report...
I20260810 03:45:29.482708 28050 ts_tablet_manager.cc:1428] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 03:45:29.482848 28051 ts_tablet_manager.cc:1428] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 03:45:29.483150 28029 heartbeater.cc:503] Master 127.22.134.254:34623 was elected leader, sending a full tablet report...
I20260810 03:45:29.485621 28052 raft_consensus.cc:348] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.485934 28052 raft_consensus.cc:374] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:29.486011 28052 raft_consensus.cc:729] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7b602248243ffb05590cacf5a984e, State: Initialized, Role: FOLLOWER
I20260810 03:45:29.486452 28052 consensus_queue.cc:260] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.487555 28052 ts_tablet_manager.cc:1428] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 03:45:29.488363 27884 heartbeater.cc:503] Master 127.22.134.254:34623 was elected leader, sending a full tablet report...
W20260810 03:45:29.658067 28032 tablet.cc:2369] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:45:29.665599 27885 tablet.cc:2369] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:45:29.689069 27733 tablet.cc:2369] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:29.719866 28057 raft_consensus.cc:482] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:29.720127 28057 raft_consensus.cc:504] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.721397 28057 leader_election.cc:288] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0e365e0f56248c792cba89ab5542507 (127.22.134.193:42423), 5eb7b602248243ffb05590cacf5a984e (127.22.134.194:32981)
I20260810 03:45:29.725731 28049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.721793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:57129 (local address 127.22.134.194:32981)
0810 03:45:29.721925 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.721930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.722197 (+ 267us) server_negotiation.cc:407] Connection header received
0810 03:45:29.722271 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.722275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.722333 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.722412 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:29.722832 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.723374 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.724652 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.725088 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.725193 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.725265 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.725506 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.725590 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:45:29.725771 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.721975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:37439 (local address 127.22.134.193:42423)
0810 03:45:29.722132 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.722136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.722324 (+ 188us) server_negotiation.cc:407] Connection header received
0810 03:45:29.722443 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.722447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.722508 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.722599 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:29.722892 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.723528 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.724629 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.725167 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.725297 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.725354 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.725538 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.725629 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 03:45:29.725771 28033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.721740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:32981 (local address 127.22.134.195:57129)
0810 03:45:29.721941 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:29.721963 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:29.722087 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:29.722444 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:29.722447 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:29.722468 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:29.722681 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.722694 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.723511 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.723515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.724494 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.724504 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.725211 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.725217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.725346 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.725377 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:45:29.725458 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 03:45:29.725630 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":57}
I20260810 03:45:29.725782 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.721792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42423 (local address 127.22.134.195:37439)
0810 03:45:29.722205 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:29.722220 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:29.722327 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:29.722620 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:29.722622 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:29.722637 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:29.722737 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.722741 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.723653 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.723655 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.724489 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:29.724498 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.725303 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.725307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:29.725391 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.725408 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 03:45:29.725502 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 03:45:29.725612 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":59,"thread_start_us":168,"threads_started":1}
I20260810 03:45:29.726578 27831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "722210edd6c74ae8b55685e0ff7c215c" candidate_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7b602248243ffb05590cacf5a984e" is_pre_election: true
I20260810 03:45:29.726583 27681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "722210edd6c74ae8b55685e0ff7c215c" candidate_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e365e0f56248c792cba89ab5542507" is_pre_election: true
I20260810 03:45:29.726883 27681 raft_consensus.cc:2454] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09590d33e1ac4dc19b3bd7ec579c4e5f in term 0.
I20260810 03:45:29.726919 27831 raft_consensus.cc:2454] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09590d33e1ac4dc19b3bd7ec579c4e5f in term 0.
I20260810 03:45:29.727519 27908 leader_election.cc:302] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 09590d33e1ac4dc19b3bd7ec579c4e5f, 5eb7b602248243ffb05590cacf5a984e, e0e365e0f56248c792cba89ab5542507; no voters:
I20260810 03:45:29.727847 28057 raft_consensus.cc:2781] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:29.727947 28057 raft_consensus.cc:482] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:29.728011 28057 raft_consensus.cc:3037] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:29.729219 28057 raft_consensus.cc:504] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.729570 28057 leader_election.cc:288] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [CANDIDATE]: Term 1 election: Requested vote from peers e0e365e0f56248c792cba89ab5542507 (127.22.134.193:42423), 5eb7b602248243ffb05590cacf5a984e (127.22.134.194:32981)
I20260810 03:45:29.729970 27681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "722210edd6c74ae8b55685e0ff7c215c" candidate_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e365e0f56248c792cba89ab5542507"
I20260810 03:45:29.730158 27681 raft_consensus.cc:3037] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:29.731323 27681 raft_consensus.cc:2454] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09590d33e1ac4dc19b3bd7ec579c4e5f in term 1.
I20260810 03:45:29.731659 27831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "722210edd6c74ae8b55685e0ff7c215c" candidate_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7b602248243ffb05590cacf5a984e"
I20260810 03:45:29.731699 27908 leader_election.cc:302] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09590d33e1ac4dc19b3bd7ec579c4e5f, e0e365e0f56248c792cba89ab5542507; no voters:
I20260810 03:45:29.731809 27831 raft_consensus.cc:3037] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:29.732007 28057 raft_consensus.cc:2781] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:29.732293 28057 raft_consensus.cc:686] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 1 LEADER]: Becoming Leader. State: Replica: 09590d33e1ac4dc19b3bd7ec579c4e5f, State: Running, Role: LEADER
I20260810 03:45:29.732667 28057 consensus_queue.cc:237] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } }
I20260810 03:45:29.733155 27831 raft_consensus.cc:2454] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09590d33e1ac4dc19b3bd7ec579c4e5f in term 1.
I20260810 03:45:29.735996 27521 catalog_manager.cc:5495] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 09590d33e1ac4dc19b3bd7ec579c4e5f (127.22.134.195). New cstate: current_term: 1 leader_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09590d33e1ac4dc19b3bd7ec579c4e5f" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260810 03:45:29.755865 28046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.752195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39878 (local address 127.22.134.195:45037)
0810 03:45:29.752348 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:29.752353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:29.752367 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:45:29.752533 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:29.752535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:29.752589 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:29.752704 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:29.752993 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.753528 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.754385 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:29.754606 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:29.754715 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:29.755040 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:29.755465 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:29.755595 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:29.755660 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 03:45:29.755721 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:29.761862 27681 raft_consensus.cc:1261] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 1 FOLLOWER]: Refusing update from remote peer 09590d33e1ac4dc19b3bd7ec579c4e5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:29.761862 27831 raft_consensus.cc:1261] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 1 FOLLOWER]: Refusing update from remote peer 09590d33e1ac4dc19b3bd7ec579c4e5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:29.762607 28057 consensus_queue.cc:1035] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0e365e0f56248c792cba89ab5542507" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:29.762874 28060 consensus_queue.cc:1035] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7b602248243ffb05590cacf5a984e" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:29.770447 28066 mvcc.cc:205] Tried to move back new op lower bound from 7316822137897050112 to 7316822137788313600. Current Snapshot: MvccSnapshot[applied={T|T < 7316822137897050112}]
I20260810 03:45:29.770907 28065 mvcc.cc:205] Tried to move back new op lower bound from 7316822137897050112 to 7316822137788313600. Current Snapshot: MvccSnapshot[applied={T|T < 7316822137897050112}]
I20260810 03:45:29.778492 27521 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:29.778690 27521 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:29.781312 27521 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4545e5d9b6a4eb2931b2c2a5e64d608: Sending DeleteTablet for 3 replicas of tablet 722210edd6c74ae8b55685e0ff7c215c
I20260810 03:45:29.782191 27959 tablet_service.cc:1514] Processing DeleteTablet for tablet 722210edd6c74ae8b55685e0ff7c215c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:29 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:39872
I20260810 03:45:29.782150 27660 tablet_service.cc:1514] Processing DeleteTablet for tablet 722210edd6c74ae8b55685e0ff7c215c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:29 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:59872
I20260810 03:45:29.782721 27806 tablet_service.cc:1514] Processing DeleteTablet for tablet 722210edd6c74ae8b55685e0ff7c215c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:29 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:42500
I20260810 03:45:29.782943 28076 tablet_replica.cc:330] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507: stopping tablet replica
I20260810 03:45:29.783318 28076 raft_consensus.cc:2229] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:29.783384 28077 tablet_replica.cc:330] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: stopping tablet replica
I20260810 03:45:29.783474 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 27591
I20260810 03:45:29.783694 28077 raft_consensus.cc:2229] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:29.783867 28076 raft_consensus.cc:2258] T 722210edd6c74ae8b55685e0ff7c215c P e0e365e0f56248c792cba89ab5542507 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:29.783998 28077 raft_consensus.cc:2258] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:29.785043 28075 tablet_replica.cc:330] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: stopping tablet replica
I20260810 03:45:29.785390 28075 raft_consensus.cc:2229] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:29.785832 28075 raft_consensus.cc:2258] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:29.786032 28077 ts_tablet_manager.cc:1905] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:29.789934 28075 ts_tablet_manager.cc:1905] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:29.790235 28077 ts_tablet_manager.cc:1918] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:29.790354 28077 log.cc:1196] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/722210edd6c74ae8b55685e0ff7c215c
I20260810 03:45:29.790709 28077 ts_tablet_manager.cc:1939] T 722210edd6c74ae8b55685e0ff7c215c P 5eb7b602248243ffb05590cacf5a984e: Deleting consensus metadata
I20260810 03:45:29.792220 27507 catalog_manager.cc:4841] TS 5eb7b602248243ffb05590cacf5a984e (127.22.134.194:32981): tablet 722210edd6c74ae8b55685e0ff7c215c (table test-table [id=9c956533e1024c1094ae72794e988d50]) successfully deleted
I20260810 03:45:29.793251 28075 ts_tablet_manager.cc:1918] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:29.793365 28075 log.cc:1196] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/722210edd6c74ae8b55685e0ff7c215c
I20260810 03:45:29.793740 28075 ts_tablet_manager.cc:1939] T 722210edd6c74ae8b55685e0ff7c215c P 09590d33e1ac4dc19b3bd7ec579c4e5f: Deleting consensus metadata
I20260810 03:45:29.795034 27508 catalog_manager.cc:4841] TS 09590d33e1ac4dc19b3bd7ec579c4e5f (127.22.134.195:45037): tablet 722210edd6c74ae8b55685e0ff7c215c (table test-table [id=9c956533e1024c1094ae72794e988d50]) successfully deleted
W20260810 03:45:29.795473 27506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:42423 (error 108)
I20260810 03:45:29.795732 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 27737
I20260810 03:45:29.797631 28044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:29.796358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42423 (local address 127.0.0.1:59880)
0810 03:45:29.797421 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:29.797521 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:42423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":948}
W20260810 03:45:29.798250 27506 catalog_manager.cc:4584] TS e0e365e0f56248c792cba89ab5542507 (127.22.134.193:42423): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 722210edd6c74ae8b55685e0ff7c215c: Network error: Client connection negotiation failed: client connection to 127.22.134.193:42423: connect: Connection refused (error 111)
I20260810 03:45:29.804867 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 27890
I20260810 03:45:29.812925 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 27490
2026-08-10T03:45:29Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4064 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T03:45:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:29Z Disabled control of system clock
I20260810 03:45:29.846493 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:37825
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:34251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:37825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 03:45:29.958961 28082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:29.959235 28082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:29.959272 28082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:29.963191 28082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:29.963248 28082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:29.963263 28082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:29.963279 28082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:29.963295 28082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:29.968163 28082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:37825
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:37825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:29.969296 28082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:29.970695 28082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:29.979682 28088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:29.979633 28091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:29.979658 28089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:29.980219 28082 server_base.cc:1034] running on GCE node
I20260810 03:45:29.980786 28082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:29.981909 28082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:29.983072 28082 hybrid_clock.cc:648] HybridClock initialized: now 1786333529983054 us; error 32 us; skew 500 ppm
I20260810 03:45:29.985193 28082 webserver.cc:460] Webserver started at http://127.22.134.254:44839/ using document root <none> and password file <none>
I20260810 03:45:29.985793 28082 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:29.985867 28082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:29.986123 28082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:29.988334 28082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "dd29934605bd471cbd934face82634a8"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "864ea6670f232ff0872cb254e29b2a1f"
server_key_iv: "f10ed7007bfc722a743ea3713676f6c2"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.988948 28082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "dd29934605bd471cbd934face82634a8"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "864ea6670f232ff0872cb254e29b2a1f"
server_key_iv: "f10ed7007bfc722a743ea3713676f6c2"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.992652 28082 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:45:29.995170 28097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:29.996426 28082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:29.996570 28082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "dd29934605bd471cbd934face82634a8"
format_stamp: "Formatted at 2026-08-10 03:45:29 on dist-test-slave-qg60"
server_key: "864ea6670f232ff0872cb254e29b2a1f"
server_key_iv: "f10ed7007bfc722a743ea3713676f6c2"
server_key_version: "encryptionkey@0"
I20260810 03:45:29.996706 28082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:30.001562 28082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:30.002238 28082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:30.002435 28082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:30.010283 28082 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:37825
I20260810 03:45:30.010300 28150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:37825 every 8 connection(s)
I20260810 03:45:30.011310 28082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:30.012550 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 28082
I20260810 03:45:30.012670 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:30.013041 23067 external_mini_cluster.cc:1428] Setting key ac648c4d250905daad06987ec8b10035
I20260810 03:45:30.015440 28151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:30.018878 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.014642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34144 (local address 127.22.134.254:37825)
0810 03:45:30.015312 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.015328 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.015364 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:45:30.016080 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.016098 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.016446 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.016812 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.017644 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.017649 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.017665 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.017675 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.017725 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.017741 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.017889 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.017958 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.018198 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":152,"threads_started":1}
I20260810 03:45:30.021776 28151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8: Bootstrap starting.
I20260810 03:45:30.024156 28151 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:30.024953 28151 log.cc:824] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:30.026942 28151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8: No bootstrap required, opened a new log
I20260810 03:45:30.030999 28151 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd29934605bd471cbd934face82634a8" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37825 } }
I20260810 03:45:30.031268 28151 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:30.031350 28151 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd29934605bd471cbd934face82634a8, State: Initialized, Role: FOLLOWER
I20260810 03:45:30.031791 28151 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd29934605bd471cbd934face82634a8" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37825 } }
I20260810 03:45:30.031950 28151 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:30.032042 28151 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:30.032147 28151 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:30.033236 28151 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd29934605bd471cbd934face82634a8" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37825 } }
I20260810 03:45:30.033595 28151 leader_election.cc:302] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd29934605bd471cbd934face82634a8; no voters:
I20260810 03:45:30.033942 28151 leader_election.cc:288] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:30.034242 28157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:30.034479 28157 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [term 1 LEADER]: Becoming Leader. State: Replica: dd29934605bd471cbd934face82634a8, State: Running, Role: LEADER
I20260810 03:45:30.034818 28157 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd29934605bd471cbd934face82634a8" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37825 } }
I20260810 03:45:30.035534 28151 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:30.036624 28158 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd29934605bd471cbd934face82634a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd29934605bd471cbd934face82634a8" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37825 } } }
I20260810 03:45:30.036819 28158 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:30.036624 28159 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd29934605bd471cbd934face82634a8. Latest consensus state: current_term: 1 leader_uuid: "dd29934605bd471cbd934face82634a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd29934605bd471cbd934face82634a8" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37825 } } }
I20260810 03:45:30.036877 28159 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:30.037405 28168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:30.040658 28168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:30.046367 28168 catalog_manager.cc:1347] Generated new cluster ID: ef074e28d138456a90ccd27afcf65b3c
I20260810 03:45:30.046461 28168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:30.062458 28168 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:30.062805 28168 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:30.070029 28168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8: Generated new TSK 0
I20260810 03:45:30.071058 28168 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:45:30.085659 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37825
--builtin_ntp_servers=127.22.134.212:34251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 03:45:30.206591 28181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:30.206856 28181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:30.206897 28181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:30.210834 28181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:30.210892 28181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:30.210947 28181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:30.215579 28181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:30.216619 28181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:30.218015 28181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:30.228786 28186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:30.228864 28187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:30.228857 28181 server_base.cc:1034] running on GCE node
W20260810 03:45:30.229038 28189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:30.229512 28181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:30.230193 28181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:30.231392 28181 hybrid_clock.cc:648] HybridClock initialized: now 1786333530231352 us; error 57 us; skew 500 ppm
I20260810 03:45:30.233386 28181 webserver.cc:460] Webserver started at http://127.22.134.193:34557/ using document root <none> and password file <none>
I20260810 03:45:30.233978 28181 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:30.234071 28181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:30.234314 28181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:30.236593 28181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "d7de47da3d064e6ea97b0a05a5e82508"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "d031c5b571f12dfa4f320da0566a54a5"
server_key_iv: "992306287475f718e8d859a79355c75e"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.237280 28181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "d7de47da3d064e6ea97b0a05a5e82508"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "d031c5b571f12dfa4f320da0566a54a5"
server_key_iv: "992306287475f718e8d859a79355c75e"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.241309 28181 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:30.244014 28195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.245363 28181 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:30.245509 28181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "d7de47da3d064e6ea97b0a05a5e82508"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "d031c5b571f12dfa4f320da0566a54a5"
server_key_iv: "992306287475f718e8d859a79355c75e"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.245636 28181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:30.250252 28181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:30.250864 28181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:30.251055 28181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:30.251624 28181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:30.252528 28181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:30.252599 28181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.252665 28181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:30.252709 28181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.261876 28181 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:43227
I20260810 03:45:30.261896 28316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:43227 every 8 connection(s)
I20260810 03:45:30.262775 28181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:30.263866 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 28181
I20260810 03:45:30.264161 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:30.264524 23067 external_mini_cluster.cc:1428] Setting key fa1bef9f5bdb07d06518278a7c407e8f
I20260810 03:45:30.266631 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37825
--builtin_ntp_servers=127.22.134.212:34251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 03:45:30.269517 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.264822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:38213 (local address 127.22.134.254:37825)
0810 03:45:30.264970 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.264975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.266179 (+ 1204us) server_negotiation.cc:407] Connection header received
0810 03:45:30.267641 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.267648 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.267696 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.267796 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.269019 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.269022 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.269025 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.269038 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.269062 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.269078 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.269188 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.269335 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.269382 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:45:30.270429 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.265273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37825 (local address 127.22.134.193:38213)
0810 03:45:30.266009 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.266061 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:30.267430 (+ 1369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:30.267946 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:30.267953 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:30.268041 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:30.268682 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:45:30.268683 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:30.268764 (+ 81us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:45:30.268854 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:30.269172 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:30.269181 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:30.269187 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:45:30.269380 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 03:45:30.269633 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":134,"threads_started":1}
I20260810 03:45:30.271821 28317 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37825
I20260810 03:45:30.272064 28317 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:30.272531 28317 heartbeater.cc:511] Master 127.22.134.254:37825 requested a full tablet report, sending...
I20260810 03:45:30.274331 28114 ts_manager.cc:194] Registered new tserver with Master: d7de47da3d064e6ea97b0a05a5e82508 (127.22.134.193:43227)
W20260810 03:45:30.380883 28320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:30.381166 28320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:30.381207 28320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:30.385229 28320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:30.385288 28320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:30.385344 28320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:30.390386 28320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:30.391500 28320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:30.392930 28320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:30.403131 28328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:30.403215 28325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:30.403357 28320 server_base.cc:1034] running on GCE node
W20260810 03:45:30.403270 28326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:30.403851 28320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:30.404582 28320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:30.405783 28320 hybrid_clock.cc:648] HybridClock initialized: now 1786333530405765 us; error 29 us; skew 500 ppm
I20260810 03:45:30.407823 28320 webserver.cc:460] Webserver started at http://127.22.134.194:46577/ using document root <none> and password file <none>
I20260810 03:45:30.408450 28320 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:30.408550 28320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:30.408860 28320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:30.410974 28320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "49219cffd6ff4157a95e5380f8e4c9d9"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "8f69a871b2e45472495121bf05d4f6b2"
server_key_iv: "33caa943acae9c4b416154fc446ce964"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.411629 28320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "49219cffd6ff4157a95e5380f8e4c9d9"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "8f69a871b2e45472495121bf05d4f6b2"
server_key_iv: "33caa943acae9c4b416154fc446ce964"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.415395 28320 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 03:45:30.417899 28334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.419114 28320 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:30.419251 28320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "49219cffd6ff4157a95e5380f8e4c9d9"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "8f69a871b2e45472495121bf05d4f6b2"
server_key_iv: "33caa943acae9c4b416154fc446ce964"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.419365 28320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:30.423960 28320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:30.424582 28320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:30.424813 28320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:30.425364 28320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:30.426278 28320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:30.426350 28320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.426422 28320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:30.426473 28320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.435307 28320 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:34743
I20260810 03:45:30.435325 28463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:34743 every 8 connection(s)
I20260810 03:45:30.436370 28320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:30.442813 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.438433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:42707 (local address 127.22.134.254:37825)
0810 03:45:30.438643 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.438648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.439712 (+ 1064us) server_negotiation.cc:407] Connection header received
0810 03:45:30.441159 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.441162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.441202 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.441288 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.442420 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.442423 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.442425 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.442437 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.442457 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.442465 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.442544 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.442662 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.442701 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:45:30.443718 28467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.438889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37825 (local address 127.22.134.194:42707)
0810 03:45:30.439557 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.439600 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:30.440887 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:30.441498 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:30.441505 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:30.441598 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:30.442164 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:45:30.442166 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:30.442212 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:45:30.442277 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:30.442543 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:30.442549 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:30.442554 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:45:30.442684 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 03:45:30.442904 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":130,"threads_started":1}
I20260810 03:45:30.444314 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 28320
I20260810 03:45:30.444455 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:30.444875 23067 external_mini_cluster.cc:1428] Setting key a543825b98ce7e58637b0b952ffedc98
I20260810 03:45:30.445197 28464 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37825
I20260810 03:45:30.445456 28464 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:30.445887 28464 heartbeater.cc:511] Master 127.22.134.254:37825 requested a full tablet report, sending...
I20260810 03:45:30.446861 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37825
--builtin_ntp_servers=127.22.134.212:34251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 03:45:30.446931 28114 ts_manager.cc:194] Registered new tserver with Master: 49219cffd6ff4157a95e5380f8e4c9d9 (127.22.134.194:34743)
W20260810 03:45:30.567296 28468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:30.567569 28468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:30.567608 28468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:30.571669 28468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:30.571733 28468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:30.571816 28468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:30.576627 28468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37825
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:30.577723 28468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:30.579090 28468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:30.589051 28477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:30.589084 28473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:30.589282 28468 server_base.cc:1034] running on GCE node
W20260810 03:45:30.589056 28474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:30.589874 28468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:30.590647 28468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:30.591864 28468 hybrid_clock.cc:648] HybridClock initialized: now 1786333530591846 us; error 31 us; skew 500 ppm
I20260810 03:45:30.594231 28468 webserver.cc:460] Webserver started at http://127.22.134.195:34441/ using document root <none> and password file <none>
I20260810 03:45:30.594905 28468 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:30.595010 28468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:30.595279 28468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:30.597676 28468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "26292b24d6c9f05a9912e3823a7c8cf6"
server_key_iv: "2b5ae12044d0c1b9abdf26377a80a62a"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.598336 28468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "26292b24d6c9f05a9912e3823a7c8cf6"
server_key_iv: "2b5ae12044d0c1b9abdf26377a80a62a"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.602684 28468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:30.605521 28483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.606856 28468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:30.607060 28468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "26292b24d6c9f05a9912e3823a7c8cf6"
server_key_iv: "2b5ae12044d0c1b9abdf26377a80a62a"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.607204 28468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:30.612057 28468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:30.612711 28468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:30.613026 28468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:30.613732 28468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:30.614732 28468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:30.614806 28468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.614881 28468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:30.614923 28468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.624339 28468 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:33421
I20260810 03:45:30.624356 28608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:33421 every 8 connection(s)
I20260810 03:45:30.625335 28468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:30.631664 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.627264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:47095 (local address 127.22.134.254:37825)
0810 03:45:30.627414 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.627417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.628545 (+ 1128us) server_negotiation.cc:407] Connection header received
0810 03:45:30.629973 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.629977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.630019 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.630114 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.631215 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.631218 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.631220 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.631233 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.631254 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.631262 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.631345 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.631464 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.631515 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:45:30.632534 28612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.627689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37825 (local address 127.22.134.195:47095)
0810 03:45:30.628366 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.628410 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:30.629745 (+ 1335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:30.630293 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:30.630300 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:30.630391 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:30.630954 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:45:30.630955 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:30.630994 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:45:30.631061 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:30.631339 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:30.631345 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:30.631350 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:45:30.631486 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 03:45:30.631688 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":127,"threads_started":1}
I20260810 03:45:30.633821 28609 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37825
I20260810 03:45:30.634075 28609 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:30.634572 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 28468
I20260810 03:45:30.634616 28609 heartbeater.cc:511] Master 127.22.134.254:37825 requested a full tablet report, sending...
I20260810 03:45:30.634696 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:30.635020 23067 external_mini_cluster.cc:1428] Setting key 0c03010efce3da70b338c9a81056a6dc
I20260810 03:45:30.636094 28114 ts_manager.cc:194] Registered new tserver with Master: 0865b9bbd9054c2a93c06b4fcfc8c27c (127.22.134.195:33421)
I20260810 03:45:30.637481 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:45:30.641526 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.639658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34146 (local address 127.22.134.254:37825)
0810 03:45:30.639881 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.639886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.640016 (+ 130us) server_negotiation.cc:407] Connection header received
0810 03:45:30.640167 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.640170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.640215 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.640321 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.641123 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.641126 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.641129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.641141 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.641162 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.641180 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.641273 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.641351 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.641394 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260810 03:45:30.644709 28113 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:30.647816 28113 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:30.661590 28623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.657673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:33421 (local address 127.0.0.1:49434)
0810 03:45:30.658694 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.659229 (+ 535us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:30.659415 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:30.659875 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:30.659878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:30.659893 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:30.660547 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:45:30.660550 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:30.660562 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:45:30.660597 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:30.661267 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:30.661271 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:30.661275 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 03:45:30.661336 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 03:45:30.661413 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":101,"threads_started":1}
I20260810 03:45:30.661898 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.658551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37376 (local address 127.22.134.194:34743)
0810 03:45:30.658925 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.658939 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.659208 (+ 269us) server_negotiation.cc:407] Connection header received
0810 03:45:30.659271 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.659281 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.659515 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.659653 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.661261 (+ 1608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.661266 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.661275 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.661286 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.661323 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.661347 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.661443 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.661657 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.661746 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":128,"threads_started":1}
I20260810 03:45:30.661911 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.659169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.22.134.193:43227)
0810 03:45:30.659714 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.659727 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.659751 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:45:30.659805 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.659811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.660009 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.660160 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.660926 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.660931 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.660966 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.660978 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.661024 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.661055 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.661172 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.661671 (+ 499us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.661758 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":126,"threads_started":1}
I20260810 03:45:30.661599 28626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.658966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:43227 (local address 127.0.0.1:44620)
0810 03:45:30.659245 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.659258 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:30.659326 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:30.660143 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:30.660146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:30.660162 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:30.660703 (+ 541us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:45:30.660705 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:30.660715 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:45:30.660764 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:30.661220 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:30.661230 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:30.661237 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:45:30.661358 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 03:45:30.661416 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":131,"threads_started":1}
I20260810 03:45:30.662362 28624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.657818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49434 (local address 127.22.134.195:33421)
0810 03:45:30.658356 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.658369 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.659329 (+ 960us) server_negotiation.cc:407] Connection header received
0810 03:45:30.659544 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.659553 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.659723 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.660124 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.661048 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.661053 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.661064 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.661074 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.661113 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.661138 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.662047 (+ 909us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.662103 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.662208 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":174,"threads_started":1}
I20260810 03:45:30.662370 28621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.657840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:34743 (local address 127.0.0.1:37376)
0810 03:45:30.658971 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.658991 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:30.659101 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:30.659684 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:30.659691 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:30.659782 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:30.660396 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:45:30.660398 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:30.660420 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:45:30.660503 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:30.661483 (+ 980us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:30.661486 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:30.661490 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 03:45:30.661557 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 03:45:30.661589 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1065,"thread_start_us":107,"threads_started":1}
I20260810 03:45:30.664889 28535 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5f370df5554b39a6e7b5ad515480d3 (DEFAULT_TABLE table=test-table [id=08e136fe3ee84288bea7f2ed561fd7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:30.665328 28389 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5f370df5554b39a6e7b5ad515480d3 (DEFAULT_TABLE table=test-table [id=08e136fe3ee84288bea7f2ed561fd7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:30.665333 28245 tablet_service.cc:1467] Processing CreateTablet for tablet 9d5f370df5554b39a6e7b5ad515480d3 (DEFAULT_TABLE table=test-table [id=08e136fe3ee84288bea7f2ed561fd7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:30.666085 28535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5f370df5554b39a6e7b5ad515480d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:30.666479 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5f370df5554b39a6e7b5ad515480d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:30.666479 28389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d5f370df5554b39a6e7b5ad515480d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:30.672367 28628 tablet_bootstrap.cc:492] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: Bootstrap starting.
I20260810 03:45:30.674649 28630 tablet_bootstrap.cc:492] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: Bootstrap starting.
I20260810 03:45:30.675057 28629 tablet_bootstrap.cc:492] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508: Bootstrap starting.
I20260810 03:45:30.675410 28628 tablet_bootstrap.cc:654] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:30.676304 28628 log.cc:824] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:30.676899 28630 tablet_bootstrap.cc:654] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:30.677142 28629 tablet_bootstrap.cc:654] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:30.677711 28630 log.cc:824] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:30.678035 28629 log.cc:824] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:30.678753 28628 tablet_bootstrap.cc:492] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: No bootstrap required, opened a new log
I20260810 03:45:30.679003 28628 ts_tablet_manager.cc:1397] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 03:45:30.679534 28630 tablet_bootstrap.cc:492] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: No bootstrap required, opened a new log
I20260810 03:45:30.679741 28630 ts_tablet_manager.cc:1397] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260810 03:45:30.680162 28629 tablet_bootstrap.cc:492] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508: No bootstrap required, opened a new log
I20260810 03:45:30.680346 28629 ts_tablet_manager.cc:1397] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 03:45:30.683269 28630 raft_consensus.cc:348] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.683519 28630 raft_consensus.cc:374] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:30.683573 28630 raft_consensus.cc:729] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49219cffd6ff4157a95e5380f8e4c9d9, State: Initialized, Role: FOLLOWER
I20260810 03:45:30.684021 28630 consensus_queue.cc:260] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.684397 28628 raft_consensus.cc:348] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.684656 28464 heartbeater.cc:503] Master 127.22.134.254:37825 was elected leader, sending a full tablet report...
I20260810 03:45:30.684681 28628 raft_consensus.cc:374] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:30.684762 28628 raft_consensus.cc:729] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0865b9bbd9054c2a93c06b4fcfc8c27c, State: Initialized, Role: FOLLOWER
I20260810 03:45:30.685082 28630 ts_tablet_manager.cc:1428] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260810 03:45:30.685274 28628 consensus_queue.cc:260] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.685429 28629 raft_consensus.cc:348] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.685698 28629 raft_consensus.cc:374] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:30.685752 28629 raft_consensus.cc:729] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7de47da3d064e6ea97b0a05a5e82508, State: Initialized, Role: FOLLOWER
I20260810 03:45:30.685968 28609 heartbeater.cc:503] Master 127.22.134.254:37825 was elected leader, sending a full tablet report...
I20260810 03:45:30.686211 28629 consensus_queue.cc:260] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.686317 28628 ts_tablet_manager.cc:1428] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260810 03:45:30.687541 28317 heartbeater.cc:503] Master 127.22.134.254:37825 was elected leader, sending a full tablet report...
W20260810 03:45:30.687556 28466 tablet.cc:2369] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:30.687965 28629 ts_tablet_manager.cc:1428] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260810 03:45:30.699276 28634 raft_consensus.cc:482] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:30.699481 28634 raft_consensus.cc:504] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.700678 28634 leader_election.cc:288] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0865b9bbd9054c2a93c06b4fcfc8c27c (127.22.134.195:33421), d7de47da3d064e6ea97b0a05a5e82508 (127.22.134.193:43227)
I20260810 03:45:30.702854 28467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.700989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:43227 (local address 127.22.134.194:52895)
0810 03:45:30.701179 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.701197 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:30.701295 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:30.701576 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:30.701579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:30.701604 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:30.702164 (+ 560us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:45:30.702167 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:30.702180 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:45:30.702212 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:30.702519 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:30.702525 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:30.702531 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:45:30.702668 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 03:45:30.702716 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 03:45:30.702878 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.701123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:52895 (local address 127.22.134.193:43227)
0810 03:45:30.701253 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.701256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.701269 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:30.701401 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.701407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.701446 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.701521 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.702360 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.702367 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.702373 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.702386 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.702407 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.702417 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.702501 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.702670 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.702723 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:45:30.703444 28624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.701083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:47233 (local address 127.22.134.195:33421)
0810 03:45:30.701230 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.701237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.701874 (+ 637us) server_negotiation.cc:407] Connection header received
0810 03:45:30.701961 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.701964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.702020 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.702135 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.702871 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.702878 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.702882 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.702900 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.702926 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.702941 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.703044 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.703273 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.703320 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:45:30.703461 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.700986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:33421 (local address 127.22.134.194:47233)
0810 03:45:30.701750 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.701782 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:30.701877 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:30.702164 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:30.702166 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:30.702196 (+ 30us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:30.702692 (+ 496us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:45:30.702694 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:30.702705 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:45:30.702730 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:30.703149 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:30.703152 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:30.703156 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 03:45:30.703269 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 03:45:30.703309 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"mutex_wait_us":378,"thread_start_us":159,"threads_started":1}
I20260810 03:45:30.703493 28267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5f370df5554b39a6e7b5ad515480d3" candidate_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7de47da3d064e6ea97b0a05a5e82508" is_pre_election: true
I20260810 03:45:30.703853 28267 raft_consensus.cc:2454] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49219cffd6ff4157a95e5380f8e4c9d9 in term 0.
I20260810 03:45:30.704068 28556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5f370df5554b39a6e7b5ad515480d3" candidate_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" is_pre_election: true
I20260810 03:45:30.704339 28338 leader_election.cc:302] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49219cffd6ff4157a95e5380f8e4c9d9, d7de47da3d064e6ea97b0a05a5e82508; no voters:
I20260810 03:45:30.704356 28556 raft_consensus.cc:2454] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49219cffd6ff4157a95e5380f8e4c9d9 in term 0.
I20260810 03:45:30.704620 28634 raft_consensus.cc:2781] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:30.704751 28634 raft_consensus.cc:482] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:30.704816 28634 raft_consensus.cc:3037] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:30.705884 28634 raft_consensus.cc:504] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.706262 28634 leader_election.cc:288] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [CANDIDATE]: Term 1 election: Requested vote from peers 0865b9bbd9054c2a93c06b4fcfc8c27c (127.22.134.195:33421), d7de47da3d064e6ea97b0a05a5e82508 (127.22.134.193:43227)
I20260810 03:45:30.706667 28556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5f370df5554b39a6e7b5ad515480d3" candidate_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c"
I20260810 03:45:30.706832 28556 raft_consensus.cc:3037] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:30.708038 28556 raft_consensus.cc:2454] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49219cffd6ff4157a95e5380f8e4c9d9 in term 1.
I20260810 03:45:30.708415 28336 leader_election.cc:302] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0865b9bbd9054c2a93c06b4fcfc8c27c, 49219cffd6ff4157a95e5380f8e4c9d9; no voters:
I20260810 03:45:30.708422 28267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d5f370df5554b39a6e7b5ad515480d3" candidate_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7de47da3d064e6ea97b0a05a5e82508"
I20260810 03:45:30.708616 28634 raft_consensus.cc:2781] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:30.708593 28267 raft_consensus.cc:3037] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:30.708925 28634 raft_consensus.cc:686] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 1 LEADER]: Becoming Leader. State: Replica: 49219cffd6ff4157a95e5380f8e4c9d9, State: Running, Role: LEADER
I20260810 03:45:30.709282 28634 consensus_queue.cc:237] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } }
I20260810 03:45:30.709992 28267 raft_consensus.cc:2454] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49219cffd6ff4157a95e5380f8e4c9d9 in term 1.
I20260810 03:45:30.712589 28114 catalog_manager.cc:5495] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49219cffd6ff4157a95e5380f8e4c9d9 (127.22.134.194). New cstate: current_term: 1 leader_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49219cffd6ff4157a95e5380f8e4c9d9" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 } health_report { overall_health: UNKNOWN } } }
I20260810 03:45:30.727279 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.725665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37392 (local address 127.22.134.194:34743)
0810 03:45:30.725825 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:30.725829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:30.725845 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:45:30.725946 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:30.725948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:30.726010 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:30.726091 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:30.726835 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:30.726838 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:30.726840 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:30.726851 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:30.726872 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:30.726880 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:30.726961 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:30.727017 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 03:45:30.727053 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:45:30.733364 28556 raft_consensus.cc:1261] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 1 FOLLOWER]: Refusing update from remote peer 49219cffd6ff4157a95e5380f8e4c9d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:30.733374 28267 raft_consensus.cc:1261] T 9d5f370df5554b39a6e7b5ad515480d3 P d7de47da3d064e6ea97b0a05a5e82508 [term 1 FOLLOWER]: Refusing update from remote peer 49219cffd6ff4157a95e5380f8e4c9d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:30.734138 28640 consensus_queue.cc:1035] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0865b9bbd9054c2a93c06b4fcfc8c27c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:30.734341 28634 consensus_queue.cc:1035] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7de47da3d064e6ea97b0a05a5e82508" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:30.743687 28644 mvcc.cc:205] Tried to move back new op lower bound from 7316822141876555776 to 7316822141787897856. Current Snapshot: MvccSnapshot[applied={T|T < 7316822141876555776}]
I20260810 03:45:30.751659 28645 mvcc.cc:205] Tried to move back new op lower bound from 7316822141876555776 to 7316822141787897856. Current Snapshot: MvccSnapshot[applied={T|T < 7316822141876555776}]
I20260810 03:45:30.752368 28113 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:30.752555 28113 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:30.755936 28113 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd29934605bd471cbd934face82634a8: Sending DeleteTablet for 3 replicas of tablet 9d5f370df5554b39a6e7b5ad515480d3
I20260810 03:45:30.756910 28535 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5f370df5554b39a6e7b5ad515480d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:30 UTC) from {username='slave'} at 127.0.0.1:49434
I20260810 03:45:30.757498 28655 tablet_replica.cc:330] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: stopping tablet replica
I20260810 03:45:30.757476 28245 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5f370df5554b39a6e7b5ad515480d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:30 UTC) from {username='slave'} at 127.0.0.1:44620
I20260810 03:45:30.757690 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 28181
I20260810 03:45:30.759459 28389 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d5f370df5554b39a6e7b5ad515480d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:30 UTC) from {username='slave'} at 127.0.0.1:37376
I20260810 03:45:30.760944 28657 tablet_replica.cc:330] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: stopping tablet replica
I20260810 03:45:30.761307 28657 raft_consensus.cc:2229] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:30.761750 28657 raft_consensus.cc:2258] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:30.762022 28655 raft_consensus.cc:2229] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:30.762444 28655 raft_consensus.cc:2258] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:30.764245 28655 ts_tablet_manager.cc:1905] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:30.766571 28657 ts_tablet_manager.cc:1905] T 9d5f370df5554b39a6e7b5ad515480d3 P 49219cffd6ff4157a95e5380f8e4c9d9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 03:45:30.766606 28101 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:43227 (error 108)
I20260810 03:45:30.767529 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 28320
I20260810 03:45:30.770187 28655 ts_tablet_manager.cc:1918] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:30.770416 28655 log.cc:1196] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/9d5f370df5554b39a6e7b5ad515480d3
I20260810 03:45:30.770833 28655 ts_tablet_manager.cc:1939] T 9d5f370df5554b39a6e7b5ad515480d3 P 0865b9bbd9054c2a93c06b4fcfc8c27c: Deleting consensus metadata
I20260810 03:45:30.772401 28099 catalog_manager.cc:4841] TS 0865b9bbd9054c2a93c06b4fcfc8c27c (127.22.134.195:33421): tablet 9d5f370df5554b39a6e7b5ad515480d3 (table test-table [id=08e136fe3ee84288bea7f2ed561fd7de]) successfully deleted
I20260810 03:45:30.776393 28621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.776016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:43227 (local address 127.0.0.1:44636)
0810 03:45:30.776169 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.776271 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:43227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 03:45:30.776602 28101 catalog_manager.cc:4584] TS d7de47da3d064e6ea97b0a05a5e82508 (127.22.134.193:43227): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9d5f370df5554b39a6e7b5ad515480d3: Network error: Client connection negotiation failed: client connection to 127.22.134.193:43227: connect: Connection refused (error 111)
I20260810 03:45:30.783517 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 28468
I20260810 03:45:30.790804 28621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:30.783686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:34743 (local address 127.0.0.1:37398)
0810 03:45:30.790579 (+ 6893us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:30.790673 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.194:34743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6740}
I20260810 03:45:30.794864 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 28082
2026-08-10T03:45:30Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (981 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 03:45:30.818750 23067 mini_oidc.cc:152] Starting JWKS server
I20260810 03:45:30.820631 23067 webserver.cc:460] Webserver started at https://127.0.0.1:34893/ using document root <none> and password file <none>
I20260810 03:45:30.821099 23067 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 03:45:30.821426 23067 webserver.cc:460] Webserver started at http://127.0.0.1:46283/ using document root <none> and password file <none>
2026-08-10T03:45:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:30Z Disabled control of system clock
I20260810 03:45:30.832342 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35899
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:37401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:35899
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34893/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/testchainca.cert with env {}
W20260810 03:45:30.948218 28664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:30.948520 28664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:30.948565 28664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:30.952625 28664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:30.952697 28664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:30.952713 28664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:30.952785 28664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:30.952812 28664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 03:45:30.952844 28664 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 03:45:30.952860 28664 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34893/jwks.json
I20260810 03:45:30.958463 28664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:37401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:35899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34893/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:30.959554 28664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:30.960574 28664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:30.969696 28670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:30.969692 28672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:30.969689 28669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:30.970367 28664 server_base.cc:1034] running on GCE node
I20260810 03:45:30.970980 28664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:30.972175 28664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:30.973340 28664 hybrid_clock.cc:648] HybridClock initialized: now 1786333530973296 us; error 61 us; skew 500 ppm
I20260810 03:45:30.975400 28664 webserver.cc:460] Webserver started at http://127.22.134.254:46845/ using document root <none> and password file <none>
I20260810 03:45:30.976017 28664 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:30.976094 28664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:30.976326 28664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:30.978631 28664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "eb1ac183f3344a0c8a87da363ac255cc"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "1d1fa3ea8919c80d6b163a7bda0eb85b"
server_key_iv: "8dbbfcd4df311c31f0dd40aed26e66c1"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.979346 28664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "eb1ac183f3344a0c8a87da363ac255cc"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "1d1fa3ea8919c80d6b163a7bda0eb85b"
server_key_iv: "8dbbfcd4df311c31f0dd40aed26e66c1"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.983533 28664 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260810 03:45:30.986310 28678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:30.987695 28664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:45:30.987948 28664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "eb1ac183f3344a0c8a87da363ac255cc"
format_stamp: "Formatted at 2026-08-10 03:45:30 on dist-test-slave-qg60"
server_key: "1d1fa3ea8919c80d6b163a7bda0eb85b"
server_key_iv: "8dbbfcd4df311c31f0dd40aed26e66c1"
server_key_version: "encryptionkey@0"
I20260810 03:45:30.988086 28664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:31.014611 28664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:31.015420 28664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:31.015655 28664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:31.023340 28664 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:35899
I20260810 03:45:31.023347 28736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:35899 every 8 connection(s)
I20260810 03:45:31.024363 28664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:31.027886 28738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:31.029729 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 28664
I20260810 03:45:31.029866 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:31.030175 23067 external_mini_cluster.cc:1428] Setting key 373589c0a333e227413c1051f0249271
I20260810 03:45:31.034933 28738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc: Bootstrap starting.
I20260810 03:45:31.037530 28738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:31.038367 28738 log.cc:824] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:31.040788 28742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:31.031733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36718 (local address 127.22.134.254:35899)
0810 03:45:31.032445 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:31.032463 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:31.032502 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:45:31.033277 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:31.033298 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:31.033766 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:31.034134 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:31.034609 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.035691 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.036672 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.037266 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.037470 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.038593 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:31.038598 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:31.038614 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:31.039160 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:31.039242 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:31.039275 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:31.039400 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:31.039621 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 03:45:31.039942 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":147,"threads_started":1}
I20260810 03:45:31.040910 28738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc: No bootstrap required, opened a new log
I20260810 03:45:31.043995 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:45:31.045228 28738 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1ac183f3344a0c8a87da363ac255cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35899 } }
I20260810 03:45:31.045527 28738 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:31.045627 28738 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb1ac183f3344a0c8a87da363ac255cc, State: Initialized, Role: FOLLOWER
I20260810 03:45:31.046132 28738 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1ac183f3344a0c8a87da363ac255cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35899 } }
I20260810 03:45:31.046298 28738 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:31.046373 28738 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:31.046478 28738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:31.047495 28738 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1ac183f3344a0c8a87da363ac255cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35899 } }
I20260810 03:45:31.047847 28738 leader_election.cc:302] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb1ac183f3344a0c8a87da363ac255cc; no voters:
I20260810 03:45:31.048209 28738 leader_election.cc:288] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:31.048390 28744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:31.048631 28744 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [term 1 LEADER]: Becoming Leader. State: Replica: eb1ac183f3344a0c8a87da363ac255cc, State: Running, Role: LEADER
I20260810 03:45:31.048970 28744 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1ac183f3344a0c8a87da363ac255cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35899 } }
I20260810 03:45:31.049593 28738 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:31.050841 28745 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb1ac183f3344a0c8a87da363ac255cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1ac183f3344a0c8a87da363ac255cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35899 } } }
I20260810 03:45:31.050979 28745 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:31.051252 28746 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb1ac183f3344a0c8a87da363ac255cc. Latest consensus state: current_term: 1 leader_uuid: "eb1ac183f3344a0c8a87da363ac255cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1ac183f3344a0c8a87da363ac255cc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35899 } } }
I20260810 03:45:31.051369 28746 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:31.051510 28753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:31.054304 28753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:31.060330 28753 catalog_manager.cc:1347] Generated new cluster ID: fae53573314f4ddf82fe2703d29e6619
I20260810 03:45:31.060424 28753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:31.082199 28753 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:31.083145 28753 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:31.091017 28753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb1ac183f3344a0c8a87da363ac255cc: Generated new TSK 0
I20260810 03:45:31.091787 28753 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 03:45:31.120818 28770 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 03:45:31.120982 28770 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 03:45:31.121632 28742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:31.103689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36734 (local address 127.22.134.254:35899)
0810 03:45:31.103822 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:31.103827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:31.104001 (+ 174us) server_negotiation.cc:407] Connection header received
0810 03:45:31.104192 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:31.104195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:31.104258 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:31.104379 (+ 121us) server_negotiation.cc:226] Negotiated authn=JWT
0810 03:45:31.104613 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.105491 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.106375 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.106734 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.106841 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.107171 (+ 330us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 03:45:31.121180 (+ 14009us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 03:45:31.121488 (+ 308us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36734: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 03:45:31.121721 28742 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36734: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 03:45:31.123013 28769 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:31.103576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35899 (local address 127.0.0.1:36734)
0810 03:45:31.103906 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:31.103919 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:31.104029 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:31.104392 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:31.104394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:31.104401 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0810 03:45:31.104501 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:31.104505 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.105624 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.105627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:31.106254 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:31.106262 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.106852 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.106854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:31.106921 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.106965 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 03:45:31.121429 (+ 14464us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 03:45:31.121637 (+ 208us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.134.254:35899: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":112,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.22.134.254:35899: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34893/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 03:45:31.123674 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 28664
2026-08-10T03:45:31Z chronyd exiting
I20260810 03:45:31.162910 23067 test_util.cc:175] -----------------------------------------------
I20260810 03:45:31.163004 23067 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786333502007595-23067-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (346 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 03:45:31.164353 23067 mini_oidc.cc:152] Starting JWKS server
I20260810 03:45:31.165319 23067 webserver.cc:460] Webserver started at https://127.0.0.1:44701/ using document root <none> and password file <none>
I20260810 03:45:31.165431 23067 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 03:45:31.165804 23067 webserver.cc:460] Webserver started at http://127.0.0.1:33215/ using document root <none> and password file <none>
2026-08-10T03:45:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:31Z Disabled control of system clock
I20260810 03:45:31.176813 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:43231
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:43867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:43231
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44701/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/testchainca.cert with env {}
W20260810 03:45:31.296762 28776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:31.297075 28776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:31.297119 28776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:31.301172 28776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:31.301245 28776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:31.301261 28776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:31.301278 28776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:31.301293 28776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 03:45:31.301311 28776 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 03:45:31.301326 28776 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44701/jwks.json
I20260810 03:45:31.306866 28776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:43231
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:43231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44701/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:31.307927 28776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:31.308924 28776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:31.317595 28784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:31.317725 28786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:31.317595 28783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:31.317759 28776 server_base.cc:1034] running on GCE node
I20260810 03:45:31.318460 28776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:31.319893 28776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:31.321061 28776 hybrid_clock.cc:648] HybridClock initialized: now 1786333531321030 us; error 51 us; skew 500 ppm
I20260810 03:45:31.323065 28776 webserver.cc:460] Webserver started at http://127.22.134.254:43893/ using document root <none> and password file <none>
I20260810 03:45:31.323863 28776 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:31.323951 28776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:31.324182 28776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:31.326351 28776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "107989f971a34cba89308b7594a7027a"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "bb44b6fff26b786e355e7cbbb6bdb443"
server_key_iv: "7ffc70f4263b97dde2784533448f34f4"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.326992 28776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "107989f971a34cba89308b7594a7027a"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "bb44b6fff26b786e355e7cbbb6bdb443"
server_key_iv: "7ffc70f4263b97dde2784533448f34f4"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.330926 28776 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260810 03:45:31.333524 28793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:31.334743 28776 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:31.334889 28776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "107989f971a34cba89308b7594a7027a"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "bb44b6fff26b786e355e7cbbb6bdb443"
server_key_iv: "7ffc70f4263b97dde2784533448f34f4"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.335017 28776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:31.351070 28776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:31.351802 28776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:31.352010 28776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:31.359454 28776 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:43231
I20260810 03:45:31.359468 28848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:43231 every 8 connection(s)
I20260810 03:45:31.360445 28776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:31.363706 28849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:31.363870 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 28776
I20260810 03:45:31.364001 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:31.364281 23067 external_mini_cluster.cc:1428] Setting key 916e9cd5d84152441f7456919c979e69
I20260810 03:45:31.370510 28849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a: Bootstrap starting.
I20260810 03:45:31.372668 28849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:31.373469 28849 log.cc:824] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:31.373723 28852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:31.365737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38284 (local address 127.22.134.254:43231)
0810 03:45:31.366563 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:31.366580 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:31.366617 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:45:31.367306 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:31.367322 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:31.367705 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:31.368048 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:31.368466 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.369498 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.370397 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.370908 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.371099 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.371991 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:31.371996 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:31.372007 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:31.372374 (+ 367us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:31.372424 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:31.372444 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:31.372558 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:31.372679 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 03:45:31.372965 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":140,"threads_started":1}
I20260810 03:45:31.375859 28849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a: No bootstrap required, opened a new log
I20260810 03:45:31.376772 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:45:31.379769 28849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107989f971a34cba89308b7594a7027a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43231 } }
I20260810 03:45:31.379999 28849 raft_consensus.cc:374] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:31.380081 28849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107989f971a34cba89308b7594a7027a, State: Initialized, Role: FOLLOWER
I20260810 03:45:31.380519 28849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107989f971a34cba89308b7594a7027a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43231 } }
I20260810 03:45:31.380661 28849 raft_consensus.cc:388] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:31.380746 28849 raft_consensus.cc:482] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:31.380864 28849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:31.381819 28849 raft_consensus.cc:504] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107989f971a34cba89308b7594a7027a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43231 } }
I20260810 03:45:31.382161 28849 leader_election.cc:302] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 107989f971a34cba89308b7594a7027a; no voters:
I20260810 03:45:31.382478 28849 leader_election.cc:288] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:31.382637 28854 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:31.383060 28854 raft_consensus.cc:686] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [term 1 LEADER]: Becoming Leader. State: Replica: 107989f971a34cba89308b7594a7027a, State: Running, Role: LEADER
I20260810 03:45:31.383409 28854 consensus_queue.cc:237] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107989f971a34cba89308b7594a7027a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43231 } }
I20260810 03:45:31.384068 28849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:31.385218 28856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 107989f971a34cba89308b7594a7027a. Latest consensus state: current_term: 1 leader_uuid: "107989f971a34cba89308b7594a7027a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107989f971a34cba89308b7594a7027a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43231 } } }
I20260810 03:45:31.385357 28856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:31.385650 28855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "107989f971a34cba89308b7594a7027a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107989f971a34cba89308b7594a7027a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43231 } } }
I20260810 03:45:31.385748 28855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:31.385860 28864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:31.388675 28864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:31.394721 28864 catalog_manager.cc:1347] Generated new cluster ID: 842a8f5f8d1b424bb3bf4928c82f07a4
I20260810 03:45:31.394804 28864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:31.401715 28864 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:31.402907 28864 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:31.417524 28864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 107989f971a34cba89308b7594a7027a: Generated new TSK 0
I20260810 03:45:31.418406 28864 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 03:45:31.445190 28881 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 03:45:31.445302 28881 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 03:45:31.446074 28852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:31.429365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38290 (local address 127.22.134.254:43231)
0810 03:45:31.429496 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:31.429500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:31.429709 (+ 209us) server_negotiation.cc:407] Connection header received
0810 03:45:31.429864 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:31.429868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:31.429927 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:31.430061 (+ 134us) server_negotiation.cc:226] Negotiated authn=JWT
0810 03:45:31.430283 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.431127 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.432014 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.432361 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.432465 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.432826 (+ 361us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 03:45:31.445609 (+ 12783us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 03:45:31.445922 (+ 313us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38290: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 03:45:31.446147 28852 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38290: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 03:45:31.446242 28880 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:31.429290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43231 (local address 127.0.0.1:38290)
0810 03:45:31.429614 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:31.429629 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:31.429731 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:31.430063 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:31.430065 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:31.430076 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0810 03:45:31.430181 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:31.430186 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.431255 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.431257 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:31.431890 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:31.431898 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.432485 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.432488 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:31.432561 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.432610 (+ 49us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 03:45:31.445846 (+ 13236us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 03:45:31.446034 (+ 188us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.134.254:43231: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":118,"threads_started":1}
I20260810 03:45:31.446920 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 28776
2026-08-10T03:45:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (325 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 03:45:31.489426 23067 mini_oidc.cc:152] Starting JWKS server
I20260810 03:45:31.490274 23067 webserver.cc:460] Webserver started at https://127.0.0.1:36075/ using document root <none> and password file <none>
I20260810 03:45:31.490355 23067 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 03:45:31.490559 23067 webserver.cc:460] Webserver started at http://127.0.0.1:36715/ using document root <none> and password file <none>
2026-08-10T03:45:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:31Z Disabled control of system clock
I20260810 03:45:31.501773 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42567
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:44631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:42567
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36075/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 03:45:31.615051 28888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:31.615360 28888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:31.615401 28888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:31.619379 28888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:31.619444 28888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:31.619459 28888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:31.619475 28888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:31.619490 28888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 03:45:31.619506 28888 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 03:45:31.619519 28888 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36075/jwks.json
I20260810 03:45:31.624226 28888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:42567
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36075/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:31.625382 28888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:31.626797 28888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:31.635877 28893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:31.635885 28896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:31.636023 28888 server_base.cc:1034] running on GCE node
W20260810 03:45:31.636225 28894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:31.636909 28888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:31.638195 28888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:31.639392 28888 hybrid_clock.cc:648] HybridClock initialized: now 1786333531639355 us; error 54 us; skew 500 ppm
I20260810 03:45:31.641513 28888 webserver.cc:460] Webserver started at http://127.22.134.254:41877/ using document root <none> and password file <none>
I20260810 03:45:31.642141 28888 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:31.642241 28888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:31.642488 28888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:31.644685 28888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "1057765de4fb4f22957c735c689c81e3"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "96055af512cb09840a2d31da9ab120cb"
server_key_iv: "9ff09b39ab80a4c147ec450cda6fb8b9"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.645385 28888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "1057765de4fb4f22957c735c689c81e3"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "96055af512cb09840a2d31da9ab120cb"
server_key_iv: "9ff09b39ab80a4c147ec450cda6fb8b9"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.649605 28888 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:45:31.652030 28903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:31.653322 28888 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 03:45:31.653462 28888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "1057765de4fb4f22957c735c689c81e3"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "96055af512cb09840a2d31da9ab120cb"
server_key_iv: "9ff09b39ab80a4c147ec450cda6fb8b9"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.653584 28888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:31.671589 28888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:31.672329 28888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:31.672544 28888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:31.680107 28888 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:42567
I20260810 03:45:31.680140 28957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:42567 every 8 connection(s)
I20260810 03:45:31.681118 28888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:31.684394 28958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:31.688274 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 28888
I20260810 03:45:31.688441 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:31.688776 23067 external_mini_cluster.cc:1428] Setting key bc2f70df38e123ae20071bf0b09b0ae1
I20260810 03:45:31.690423 28958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3: Bootstrap starting.
I20260810 03:45:31.692937 28958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:31.693730 28958 log.cc:824] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:31.695653 28958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3: No bootstrap required, opened a new log
I20260810 03:45:31.698359 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:31.690282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39166 (local address 127.22.134.254:42567)
0810 03:45:31.691030 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:31.691047 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:31.691083 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:45:31.691741 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:31.691759 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:31.692193 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:31.692528 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:31.693029 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.694145 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.695036 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.695511 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.695691 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.696565 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:31.696570 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:31.696583 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:31.697036 (+ 453us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:31.697090 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:31.697110 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:31.697223 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:31.697386 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 03:45:31.697640 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":170,"threads_started":1}
I20260810 03:45:31.699385 28958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1057765de4fb4f22957c735c689c81e3" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42567 } }
I20260810 03:45:31.699635 28958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:31.699714 28958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1057765de4fb4f22957c735c689c81e3, State: Initialized, Role: FOLLOWER
I20260810 03:45:31.700227 28958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1057765de4fb4f22957c735c689c81e3" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42567 } }
I20260810 03:45:31.700403 28958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:31.700471 28958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:31.700577 28958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:31.701267 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:45:31.701748 28958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1057765de4fb4f22957c735c689c81e3" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42567 } }
I20260810 03:45:31.702137 28958 leader_election.cc:302] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1057765de4fb4f22957c735c689c81e3; no voters:
I20260810 03:45:31.702518 28958 leader_election.cc:288] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:31.702606 28965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:31.702797 28965 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [term 1 LEADER]: Becoming Leader. State: Replica: 1057765de4fb4f22957c735c689c81e3, State: Running, Role: LEADER
I20260810 03:45:31.703121 28965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1057765de4fb4f22957c735c689c81e3" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42567 } }
I20260810 03:45:31.703884 28958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:31.704902 28968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1057765de4fb4f22957c735c689c81e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1057765de4fb4f22957c735c689c81e3" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42567 } } }
I20260810 03:45:31.705313 28968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:31.705211 28966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1057765de4fb4f22957c735c689c81e3. Latest consensus state: current_term: 1 leader_uuid: "1057765de4fb4f22957c735c689c81e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1057765de4fb4f22957c735c689c81e3" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42567 } } }
I20260810 03:45:31.705643 28966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3 [sys.catalog]: This master's current role is: LEADER
W20260810 03:45:31.708914 28984 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:31.708997 28984 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:31.709077 28976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:31.709771 28976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:31.715402 28976 catalog_manager.cc:1347] Generated new cluster ID: 8369da3980c04b39863bb3039e1344e3
I20260810 03:45:31.715495 28976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:31.736241 28976 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:31.737316 28976 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:31.742166 28976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1057765de4fb4f22957c735c689c81e3: Generated new TSK 0
I20260810 03:45:31.742974 28976 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:45:31.758962 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:31.753546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39174 (local address 127.22.134.254:42567)
0810 03:45:31.753710 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:31.753715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:31.753913 (+ 198us) server_negotiation.cc:407] Connection header received
0810 03:45:31.754091 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:31.754093 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:31.754142 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:31.754227 (+ 85us) server_negotiation.cc:226] Negotiated authn=JWT
0810 03:45:31.754484 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.755050 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.756317 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.756534 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.756664 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.757076 (+ 412us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 03:45:31.758591 (+ 1515us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36075/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 03:45:31.758823 (+ 232us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39174: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36075/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":74}
W20260810 03:45:31.759035 28962 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39174: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36075/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 03:45:31.760849 28993 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:31.753470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42567 (local address 127.0.0.1:39174)
0810 03:45:31.753815 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:31.753832 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:31.753948 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:31.754253 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:31.754257 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:31.754265 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 03:45:31.754377 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:31.754382 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.755167 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.755171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:31.756185 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:31.756196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.756750 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.756755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:31.756846 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:31.756876 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 03:45:31.758779 (+ 1903us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36075/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 03:45:31.760636 (+ 1857us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.134.254:42567: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36075/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":1647,"thread_start_us":145,"threads_started":1}
I20260810 03:45:31.761459 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 28888
E20260810 03:45:31.774441 28994 webserver.cc:533] Webserver: sslize failed:
E20260810 03:45:31.774528 28994 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T03:45:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (317 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T03:45:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:31Z Disabled control of system clock
I20260810 03:45:31.816025 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:46795
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:43877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:46795
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/testchainca.cert with env {}
W20260810 03:45:31.929700 28998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:31.929986 28998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:31.930027 28998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:31.934259 28998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:31.934326 28998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:31.934341 28998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:31.934358 28998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:31.934374 28998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 03:45:31.934391 28998 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 03:45:31.934444 28998 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 03:45:31.939880 28998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:46795
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:46795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:31.941088 28998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:31.942238 28998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:31.950922 29003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:31.950930 29004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:31.951086 28998 server_base.cc:1034] running on GCE node
W20260810 03:45:31.951278 29006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:31.951836 28998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:31.953068 28998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:31.954262 28998 hybrid_clock.cc:648] HybridClock initialized: now 1786333531954241 us; error 32 us; skew 500 ppm
I20260810 03:45:31.956216 28998 webserver.cc:460] Webserver started at http://127.22.134.254:43011/ using document root <none> and password file <none>
I20260810 03:45:31.956871 28998 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:31.956969 28998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:31.957201 28998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:31.959331 28998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "0bee4ee5da844c01ad098c3f52a90d7e"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "094f73cea51080ea27c68afa184abea6"
server_key_iv: "076878620b8f372760850bd0b8160b3c"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.959978 28998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "0bee4ee5da844c01ad098c3f52a90d7e"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "094f73cea51080ea27c68afa184abea6"
server_key_iv: "076878620b8f372760850bd0b8160b3c"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.963842 28998 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 03:45:31.966425 29014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:31.967705 28998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:31.967844 28998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "0bee4ee5da844c01ad098c3f52a90d7e"
format_stamp: "Formatted at 2026-08-10 03:45:31 on dist-test-slave-qg60"
server_key: "094f73cea51080ea27c68afa184abea6"
server_key_iv: "076878620b8f372760850bd0b8160b3c"
server_key_version: "encryptionkey@0"
I20260810 03:45:31.967998 28998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:31.980659 28998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:31.981439 28998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:31.981654 28998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:31.988953 28998 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:46795
I20260810 03:45:31.988994 29068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:46795 every 8 connection(s)
I20260810 03:45:31.989969 28998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:31.992403 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 28998
I20260810 03:45:31.992563 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:31.992915 23067 external_mini_cluster.cc:1428] Setting key 236559e48f3aaac00deca0d03260948c
I20260810 03:45:31.993394 29069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:31.999714 29069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e: Bootstrap starting.
I20260810 03:45:32.002193 29069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:32.002370 29072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:31.994256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43538 (local address 127.22.134.254:46795)
0810 03:45:31.994937 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:31.994958 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:31.995003 (+ 45us) server_negotiation.cc:407] Connection header received
0810 03:45:31.995959 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:31.995976 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:31.996364 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:31.996706 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:31.997163 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.998125 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.999006 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:31.999482 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:31.999671 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:32.000577 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:32.000582 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:32.000594 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:45:32.001056 (+ 462us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:32.001109 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:45:32.001130 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:32.001248 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:32.001364 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 03:45:32.001616 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":140,"threads_started":1}
I20260810 03:45:32.003149 29069 log.cc:824] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:32.005336 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:45:32.005556 29069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e: No bootstrap required, opened a new log
I20260810 03:45:32.009750 29069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bee4ee5da844c01ad098c3f52a90d7e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46795 } }
I20260810 03:45:32.010154 29069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:32.010221 29069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bee4ee5da844c01ad098c3f52a90d7e, State: Initialized, Role: FOLLOWER
I20260810 03:45:32.010723 29069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bee4ee5da844c01ad098c3f52a90d7e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46795 } }
I20260810 03:45:32.010872 29069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:32.010944 29069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:32.011044 29069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:32.012147 29069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bee4ee5da844c01ad098c3f52a90d7e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46795 } }
I20260810 03:45:32.012513 29069 leader_election.cc:302] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bee4ee5da844c01ad098c3f52a90d7e; no voters:
I20260810 03:45:32.012974 29069 leader_election.cc:288] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:32.013098 29075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:32.013366 29075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [term 1 LEADER]: Becoming Leader. State: Replica: 0bee4ee5da844c01ad098c3f52a90d7e, State: Running, Role: LEADER
I20260810 03:45:32.013666 29075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bee4ee5da844c01ad098c3f52a90d7e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46795 } }
I20260810 03:45:32.014364 29069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:32.015465 29076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bee4ee5da844c01ad098c3f52a90d7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bee4ee5da844c01ad098c3f52a90d7e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46795 } } }
I20260810 03:45:32.015465 29077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bee4ee5da844c01ad098c3f52a90d7e. Latest consensus state: current_term: 1 leader_uuid: "0bee4ee5da844c01ad098c3f52a90d7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bee4ee5da844c01ad098c3f52a90d7e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46795 } } }
I20260810 03:45:32.015733 29076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:32.015868 29077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:32.016229 29086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:32.019539 29086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:32.025852 29086 catalog_manager.cc:1347] Generated new cluster ID: 9de624003e40425590182de9422e74c5
I20260810 03:45:32.025944 29086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:32.052661 29086 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:32.053655 29086 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:32.066689 29086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bee4ee5da844c01ad098c3f52a90d7e: Generated new TSK 0
I20260810 03:45:32.067416 29086 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:45:32.537073 29103 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:32.078828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:46795 (local address 127.0.0.1:43548)
0810 03:45:32.079169 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:32.079184 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:32.079283 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:32.079581 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:32.079583 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:32.079589 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0810 03:45:32.079684 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:32.079688 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:32.080772 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:32.080775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:32.081387 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:32.081395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:32.082017 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:32.082020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:32.082087 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:32.082108 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 03:45:32.536675 (+454567us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 03:45:32.536914 (+ 239us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.134.254:46795: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":113,"threads_started":1}
I20260810 03:45:32.537079 29072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:32.078903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43548 (local address 127.22.134.254:46795)
0810 03:45:32.079028 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:32.079032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:32.079285 (+ 253us) server_negotiation.cc:407] Connection header received
0810 03:45:32.079401 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:32.079405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:32.079465 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:32.079581 (+ 116us) server_negotiation.cc:226] Negotiated authn=JWT
0810 03:45:32.079790 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:32.080590 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:32.081515 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:32.081884 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:32.081987 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:32.082281 (+ 294us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 03:45:32.536395 (+454114us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 03:45:32.536704 (+ 309us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43548: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":44}
W20260810 03:45:32.537182 29072 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43548: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260810 03:45:32.537845 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 28998
2026-08-10T03:45:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (754 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (132 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (134 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:32 dist-test-slave-qg60 krb5kdc[29116](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:32 dist-test-slave-qg60 krb5kdc[29116](info): set up 2 sockets
Aug 10 03:45:32 dist-test-slave-qg60 krb5kdc[29116](info): commencing operation
krb5kdc: starting...
W20260810 03:45:33.934865 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:34 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:34.078327 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:34723
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:34723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:34.194340 29131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:34.194644 29131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:34.194691 29131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:34.199258 29131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:34.199329 29131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:34.199352 29131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:34.199369 29131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:34.199388 29131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:34.205377 29131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:34723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:34723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:34.206509 29131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:34.207569 29131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:34.216922 29139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:34.217008 29131 server_base.cc:1034] running on GCE node
W20260810 03:45:34.216914 29137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:34.216935 29136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:34.217881 29131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:34.219014 29131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:34.220213 29131 hybrid_clock.cc:648] HybridClock initialized: now 1786333534220183 us; error 43 us; skew 500 ppm
Aug 10 03:45:34 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:34.223374 29131 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:34.224305 29131 webserver.cc:460] Webserver started at http://127.22.134.254:42707/ using document root <none> and password file <none>
I20260810 03:45:34.224964 29131 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:34.225060 29131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:34.225306 29131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:34.227450 29131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "4be5414123fc478292722a7a754c1d9b"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "6c622eb5d9fb2fd40d3ae36479b6f7ef"
server_key_iv: "117b348af4df738b20fa6238fec58c80"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.228032 29131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "4be5414123fc478292722a7a754c1d9b"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "6c622eb5d9fb2fd40d3ae36479b6f7ef"
server_key_iv: "117b348af4df738b20fa6238fec58c80"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.232167 29131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:45:34.234879 29147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:34.236218 29131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:34.236366 29131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "4be5414123fc478292722a7a754c1d9b"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "6c622eb5d9fb2fd40d3ae36479b6f7ef"
server_key_iv: "117b348af4df738b20fa6238fec58c80"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.236491 29131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:34.256664 29131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:34.259836 29131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:34.260051 29131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:34.267454 29131 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:34723
I20260810 03:45:34.267472 29202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:34723 every 8 connection(s)
I20260810 03:45:34.268468 29131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:34.271371 29203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:34.276153 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 29131
I20260810 03:45:34.276293 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:34.276629 23067 external_mini_cluster.cc:1428] Setting key 4648049ff3d105fe2710c94e539cddc5
I20260810 03:45:34.278420 29203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b: Bootstrap starting.
I20260810 03:45:34.280714 29203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:34.281562 29203 log.cc:824] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:34.283803 29203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b: No bootstrap required, opened a new log
Aug 10 03:45:34 dist-test-slave-qg60 krb5kdc[29116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:34.287889 29203 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be5414123fc478292722a7a754c1d9b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34723 } }
I20260810 03:45:34.288146 29203 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:34.288229 29203 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be5414123fc478292722a7a754c1d9b, State: Initialized, Role: FOLLOWER
I20260810 03:45:34.288678 29203 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be5414123fc478292722a7a754c1d9b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34723 } }
I20260810 03:45:34.288887 29203 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:34.288977 29203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:34.289104 29203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:34.290051 29203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be5414123fc478292722a7a754c1d9b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34723 } }
I20260810 03:45:34.290434 29203 leader_election.cc:302] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4be5414123fc478292722a7a754c1d9b; no voters:
I20260810 03:45:34.290825 29203 leader_election.cc:288] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:34.291203 29211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:34.291425 29211 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [term 1 LEADER]: Becoming Leader. State: Replica: 4be5414123fc478292722a7a754c1d9b, State: Running, Role: LEADER
I20260810 03:45:34.292196 29208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:34.278091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57522 (local address 127.22.134.254:34723)
0810 03:45:34.278590 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:34.278606 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:34.278644 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:45:34.279268 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:34.279284 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:34.279600 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:34.279950 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:34.280839 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.281912 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.283151 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.283606 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.283733 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:34.286674 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:34.286680 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:34.286693 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:34.286719 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:34.288780 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:34.289315 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:34.289321 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:34.289327 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:34.289445 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:34.289742 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:34.289746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:34.289747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:34.290146 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:34.290343 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:34.290656 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 03:45:34.291002 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":140,"threads_started":1}
I20260810 03:45:34.292212 29203 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:34.292366 29211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be5414123fc478292722a7a754c1d9b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34723 } }
I20260810 03:45:34.294113 29213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4be5414123fc478292722a7a754c1d9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be5414123fc478292722a7a754c1d9b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34723 } } }
I20260810 03:45:34.294240 29213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:34.294523 29210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4be5414123fc478292722a7a754c1d9b. Latest consensus state: current_term: 1 leader_uuid: "4be5414123fc478292722a7a754c1d9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be5414123fc478292722a7a754c1d9b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34723 } } }
I20260810 03:45:34.295151 29210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b [sys.catalog]: This master's current role is: LEADER
W20260810 03:45:34.297089 29226 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:34.297178 29226 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:34.297452 29225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:34.298439 29225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:34.304476 29225 catalog_manager.cc:1347] Generated new cluster ID: c451dd15f1cf4f948d4e1aa5575213bc
I20260810 03:45:34.304546 29225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:34.355131 29225 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:34.356472 29225 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:34.363754 29225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4be5414123fc478292722a7a754c1d9b: Generated new TSK 0
I20260810 03:45:34.364579 29225 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:34.404037 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34723
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:34.518080 29232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:34.518348 29232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:34.518392 29232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:34.523440 29232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:34.523526 29232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:34.523644 29232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:34.529706 29232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:34.530951 29232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:34.532181 29232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:34.543077 29239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:34.543077 29238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:34.543119 29241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:34.543553 29232 server_base.cc:1034] running on GCE node
I20260810 03:45:34.544008 29232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:34.544708 29232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:34.545943 29232 hybrid_clock.cc:648] HybridClock initialized: now 1786333534545912 us; error 42 us; skew 500 ppm
Aug 10 03:45:34 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:34.548883 29232 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:34.549746 29232 webserver.cc:460] Webserver started at http://127.22.134.193:40511/ using document root <none> and password file <none>
I20260810 03:45:34.550275 29232 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:34.550340 29232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:34.550506 29232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:34.552470 29232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "e81a111de35f4154b201af046cfe7506"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "091dec9f0f360acd87811706ceff768d"
server_key_iv: "09db4f85d75df3af2cf4f1fece475759"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.553043 29232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "e81a111de35f4154b201af046cfe7506"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "091dec9f0f360acd87811706ceff768d"
server_key_iv: "09db4f85d75df3af2cf4f1fece475759"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.556624 29232 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260810 03:45:34.559130 29249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:34.560348 29232 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:34.560472 29232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "e81a111de35f4154b201af046cfe7506"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "091dec9f0f360acd87811706ceff768d"
server_key_iv: "09db4f85d75df3af2cf4f1fece475759"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.560582 29232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:34.578588 29232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:34.582075 29232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:34.582294 29232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:34.583106 29232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:34.584018 29232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:34.584070 29232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:34.584112 29232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:34.584161 29232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:34.593401 29232 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:43641
I20260810 03:45:34.593466 29376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:43641 every 8 connection(s)
I20260810 03:45:34.594432 29232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:34.601852 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 29232
I20260810 03:45:34.601969 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:34.602391 23067 external_mini_cluster.cc:1428] Setting key 2337c6b5251c20e7adab3d2ce4d55ca7
Aug 10 03:45:34 dist-test-slave-qg60 krb5kdc[29116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:34.610396 29208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:34.596377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:34981 (local address 127.22.134.254:34723)
0810 03:45:34.596538 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:34.596543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:34.597517 (+ 974us) server_negotiation.cc:407] Connection header received
0810 03:45:34.599022 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:34.599025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:34.599082 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:34.599162 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:34.600365 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.600920 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.602305 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.602648 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.602786 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:34.606097 (+ 3311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:34.606105 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:34.606110 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:34.606148 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:34.607751 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:34.608466 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:34.608469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:34.608470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:34.608553 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:34.609048 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:34.609051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:34.609052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:34.609262 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:34.609342 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:34.610145 (+ 803us) server_negotiation.cc:299] Negotiation successful
0810 03:45:34.610267 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:45:34.611747 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:34.596868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:34723 (local address 127.22.134.193:34981)
0810 03:45:34.597347 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:34.597393 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:34.598793 (+ 1400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:34.599341 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:34.599348 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:34.599722 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:34.600221 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:34.600234 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.601069 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.601073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:34.602163 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:34.602173 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.602838 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.602842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:34.603127 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:34.603839 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:34.603856 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:34.605848 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:34.607892 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:34.607902 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:34.607923 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:34.608333 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:34.608667 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:34.608674 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:34.608679 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:34.608919 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:34.609379 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:34.609390 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:34.609790 (+ 400us) client_negotiation.cc:769] Sending connection context
0810 03:45:34.610046 (+ 256us) client_negotiation.cc:240] Negotiation successful
0810 03:45:34.610497 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":118,"threads_started":1}
I20260810 03:45:34.613274 29377 heartbeater.cc:347] Connected to a master server at 127.22.134.254:34723
I20260810 03:45:34.613565 29377 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:34.614214 29377 heartbeater.cc:511] Master 127.22.134.254:34723 requested a full tablet report, sending...
I20260810 03:45:34.616010 29166 ts_manager.cc:194] Registered new tserver with Master: e81a111de35f4154b201af046cfe7506 (127.22.134.193:43641)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:45:34.617463 29166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:34981
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:34.636658 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34723
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:34.756389 29382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:34.756855 29382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:34.756940 29382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:34.763835 29382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:34.763947 29382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:34.764052 29382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:34.772408 29382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:34.773907 29382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:34.775393 29382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:34.785480 29388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:34.785475 29387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:34.785665 29382 server_base.cc:1034] running on GCE node
W20260810 03:45:34.785513 29390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:34.786144 29382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:34.786854 29382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:34.788015 29382 hybrid_clock.cc:648] HybridClock initialized: now 1786333534787999 us; error 27 us; skew 500 ppm
Aug 10 03:45:34 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:34.791062 29382 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:34.792135 29382 webserver.cc:460] Webserver started at http://127.22.134.194:45801/ using document root <none> and password file <none>
I20260810 03:45:34.792912 29382 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:34.793049 29382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:34.793311 29382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:34.795734 29382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "7b996bc1ec9d4bdea355d8669738424e"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "6bad96123b20f0ad24934300070d7ddd"
server_key_iv: "20dc606a578a2b329a6393dcf6d50cf3"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.796285 29382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "7b996bc1ec9d4bdea355d8669738424e"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "6bad96123b20f0ad24934300070d7ddd"
server_key_iv: "20dc606a578a2b329a6393dcf6d50cf3"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.800222 29382 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:45:34.802947 29398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:34.804549 29382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:34.804718 29382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "7b996bc1ec9d4bdea355d8669738424e"
format_stamp: "Formatted at 2026-08-10 03:45:34 on dist-test-slave-qg60"
server_key: "6bad96123b20f0ad24934300070d7ddd"
server_key_iv: "20dc606a578a2b329a6393dcf6d50cf3"
server_key_version: "encryptionkey@0"
I20260810 03:45:34.804895 29382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:34.834156 29382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:34.837568 29382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:34.837797 29382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:34.838472 29382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:34.839393 29382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:34.839443 29382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:34.839519 29382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:34.839601 29382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:34.848687 29382 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:37241
I20260810 03:45:34.848780 29523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:37241 every 8 connection(s)
I20260810 03:45:34.849762 29382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:34.854682 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 29382
I20260810 03:45:34.854794 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:34.855082 23067 external_mini_cluster.cc:1428] Setting key 4187bc38110ada870eb9692a2d2757f7
Aug 10 03:45:34 dist-test-slave-qg60 krb5kdc[29116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:34.864343 29208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:34.851670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:60685 (local address 127.22.134.254:34723)
0810 03:45:34.851829 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:34.851833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:34.852666 (+ 833us) server_negotiation.cc:407] Connection header received
0810 03:45:34.854002 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:34.854005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:34.854054 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:34.854133 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:34.855419 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.856082 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.857256 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.857486 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.857600 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:34.860421 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:34.860425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:34.860427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:34.860462 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:34.862022 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:34.862556 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:34.862560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:34.862562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:34.862653 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:34.863003 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:34.863009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:34.863013 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:34.863280 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:34.863394 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:34.863998 (+ 604us) server_negotiation.cc:299] Negotiation successful
0810 03:45:34.864154 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:45:34.865248 29526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:34.851995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:34723 (local address 127.22.134.194:60685)
0810 03:45:34.852500 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:34.852544 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:34.853800 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:34.854306 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:34.854312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:34.854663 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:34.855264 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:34.855280 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.856218 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.856221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:34.857119 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:34.857128 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:34.857639 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:34.857643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:34.857827 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:34.858475 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:34.858503 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:34.860242 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:34.862151 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:34.862158 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:34.862174 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:34.862445 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:34.862749 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:34.862753 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:34.862755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:34.862900 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:34.863391 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:34.863399 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:34.863716 (+ 317us) client_negotiation.cc:769] Sending connection context
0810 03:45:34.863946 (+ 230us) client_negotiation.cc:240] Negotiation successful
0810 03:45:34.864293 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:45:34.866535 29524 heartbeater.cc:347] Connected to a master server at 127.22.134.254:34723
I20260810 03:45:34.866794 29524 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:34.867385 29524 heartbeater.cc:511] Master 127.22.134.254:34723 requested a full tablet report, sending...
I20260810 03:45:34.868543 29166 ts_manager.cc:194] Registered new tserver with Master: 7b996bc1ec9d4bdea355d8669738424e (127.22.134.194:37241)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
I20260810 03:45:34.869334 29166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:60685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:34.886034 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34723
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:45759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:35.003239 29529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:35.003530 29529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:35.003574 29529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:35.007769 29529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:35.007850 29529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:35.007913 29529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:35.013935 29529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:45759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:34723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:35.015053 29529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:35.016033 29529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:35.026525 29538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:35.026531 29535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:35.026527 29534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:35.026805 29529 server_base.cc:1034] running on GCE node
I20260810 03:45:35.027343 29529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:35.028059 29529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:35.029227 29529 hybrid_clock.cc:648] HybridClock initialized: now 1786333535029214 us; error 28 us; skew 500 ppm
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:35.032313 29529 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:35.033434 29529 webserver.cc:460] Webserver started at http://127.22.134.195:42561/ using document root <none> and password file <none>
I20260810 03:45:35.034065 29529 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:35.034133 29529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:35.034361 29529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:35.036681 29529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "58ab6644e2ef48cb906f4ec5f5a49c71"
format_stamp: "Formatted at 2026-08-10 03:45:35 on dist-test-slave-qg60"
server_key: "a098d8caddc69a7a5cc7717d74bcea35"
server_key_iv: "8ee4fcee40a86de90b806807630488d7"
server_key_version: "encryptionkey@0"
I20260810 03:45:35.037369 29529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "58ab6644e2ef48cb906f4ec5f5a49c71"
format_stamp: "Formatted at 2026-08-10 03:45:35 on dist-test-slave-qg60"
server_key: "a098d8caddc69a7a5cc7717d74bcea35"
server_key_iv: "8ee4fcee40a86de90b806807630488d7"
server_key_version: "encryptionkey@0"
I20260810 03:45:35.041827 29529 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:45:35.044379 29546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:35.045795 29529 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:45:35.045950 29529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "58ab6644e2ef48cb906f4ec5f5a49c71"
format_stamp: "Formatted at 2026-08-10 03:45:35 on dist-test-slave-qg60"
server_key: "a098d8caddc69a7a5cc7717d74bcea35"
server_key_iv: "8ee4fcee40a86de90b806807630488d7"
server_key_version: "encryptionkey@0"
I20260810 03:45:35.046131 29529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:35.058945 29529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:35.062412 29529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:35.062629 29529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:35.063354 29529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:35.064299 29529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:35.064361 29529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:35.064424 29529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:35.064478 29529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:35.073388 29529 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:39587
I20260810 03:45:35.073457 29671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:39587 every 8 connection(s)
I20260810 03:45:35.074469 29529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:35.083590 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 29529
I20260810 03:45:35.083701 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:35.083997 23067 external_mini_cluster.cc:1428] Setting key 8ab2f2e0f7ecb05076ed5b575e96c01f
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:35.089151 29208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:35.076447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:55313 (local address 127.22.134.254:34723)
0810 03:45:35.076630 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:35.076634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:35.077523 (+ 889us) server_negotiation.cc:407] Connection header received
0810 03:45:35.079006 (+ 1483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:35.079009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:35.079068 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:35.079151 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:35.080360 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.080970 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.082132 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.082354 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.082466 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:35.085550 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:35.085555 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:35.085558 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:35.085588 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:35.087132 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:35.087627 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:35.087629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:35.087631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:35.087710 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:35.088046 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:35.088051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:35.088052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:35.088251 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:35.088345 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:35.088896 (+ 551us) server_negotiation.cc:299] Negotiation successful
0810 03:45:35.089028 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:45:35.090019 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:35.076856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:34723 (local address 127.22.134.195:55313)
0810 03:45:35.077367 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:35.077414 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:35.078783 (+ 1369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:35.079342 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:35.079348 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:35.079723 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:35.080209 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:35.080223 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.081103 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.081107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:35.081992 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:35.082002 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.082511 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.082515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:35.082694 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:35.083346 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:35.083364 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:35.085331 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:35.087259 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:35.087264 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:35.087278 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:35.087534 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:35.087794 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:35.087796 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:35.087797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:35.087927 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:35.088350 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:35.088355 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:35.088589 (+ 234us) client_negotiation.cc:769] Sending connection context
0810 03:45:35.088772 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 03:45:35.089085 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":112,"threads_started":1}
I20260810 03:45:35.091213 29672 heartbeater.cc:347] Connected to a master server at 127.22.134.254:34723
I20260810 03:45:35.091485 29672 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:35.091991 29672 heartbeater.cc:511] Master 127.22.134.254:34723 requested a full tablet report, sending...
I20260810 03:45:35.093181 29166 ts_manager.cc:194] Registered new tserver with Master: 58ab6644e2ef48cb906f4ec5f5a49c71 (127.22.134.195:39587)
I20260810 03:45:35.093782 29166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:55313
I20260810 03:45:35.098248 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/test-admin.keytab.
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:35.117851 23067 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 03:45:35.121117 29681 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:35.119366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51880 (local address 127.22.134.193:43641)
0810 03:45:35.119754 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:35.119761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:35.119785 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:45:35.119837 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:35.119843 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:35.120032 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:35.120273 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:35.120855 (+ 582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51880: BlockingRecv error: recv got EOF from 127.0.0.1:51880 (error 108)
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":144,"threads_started":1}
W20260810 03:45:35.121119 23067 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5cc' of type FILE
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:35.122326 23067 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:35.123521 23067 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:35.134276 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:35.124530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51892 (local address 127.22.134.193:43641)
0810 03:45:35.124719 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:35.124764 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:35.124784 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:45:35.124944 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:35.124947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:35.124995 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:35.125113 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:35.125623 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.126638 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.127459 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.127845 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.127930 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:35.130573 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:35.130584 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:35.130599 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:35.130626 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:35.132462 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:35.133021 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:35.133026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:35.133028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:35.133120 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:35.133349 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:35.133351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:35.133352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:35.133592 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:35.133759 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:35.133923 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 03:45:35.134104 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260810 03:45:35.138456 29681 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:35.137286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.22.134.193:43641)
0810 03:45:35.137443 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:35.137447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:35.137562 (+ 115us) server_negotiation.cc:407] Connection header received
0810 03:45:35.137759 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:35.137762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:35.137801 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:35.137886 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:35.138311 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51900: BlockingRecv error: recv got EOF from 127.0.0.1:51900 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260810 03:45:35.138582 23067 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5cc' of type FILE
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:35.139791 23067 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:35.140929 23067 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:35.151489 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:35.142002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51906 (local address 127.22.134.193:43641)
0810 03:45:35.142184 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:35.142189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:35.142308 (+ 119us) server_negotiation.cc:407] Connection header received
0810 03:45:35.142457 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:35.142461 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:35.142502 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:35.142599 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:35.143192 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.143745 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.144661 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.144963 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.145088 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:35.147866 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:35.147870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:35.147872 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:35.147902 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:35.149624 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:35.150209 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:35.150217 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:35.150224 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:35.150317 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:35.150623 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:35.150626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:35.150628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:35.150820 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:35.150988 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:35.151201 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 03:45:35.151322 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260810 03:45:35.154557 29681 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:35.153605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51908 (local address 127.22.134.193:43641)
0810 03:45:35.153754 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:35.153757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:35.153820 (+ 63us) server_negotiation.cc:407] Connection header received
0810 03:45:35.153943 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:35.153945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:35.153982 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:35.154047 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:35.154456 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51908: BlockingRecv error: recv got EOF from 127.0.0.1:51908 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260810 03:45:35.154690 23067 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786333502007595-23067-0/krb5kdc/krb5cc' of type FILE
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:35.155864 23067 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:35.156927 23067 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:45:35.166049 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:35.157893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51910 (local address 127.22.134.193:43641)
0810 03:45:35.158033 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:35.158036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:35.158059 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:45:35.158198 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:35.158200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:35.158238 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:35.158307 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:35.158887 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.159402 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.160238 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:35.160461 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:35.160558 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:35.162930 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:35.162934 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:35.162936 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:35.162959 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:35.164317 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:35.164913 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:35.164919 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:35.164921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:35.165010 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:35.165250 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:35.165252 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:35.165253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:35.165412 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:35.165525 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:35.165733 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 03:45:35.165849 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:45:35.167163 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 29232
I20260810 03:45:35.176106 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 29382
I20260810 03:45:35.189327 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 29529
I20260810 03:45:35.199191 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 29131
2026-08-10T03:45:35Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2394 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29698](info): set up 2 sockets
Aug 10 03:45:35 dist-test-slave-qg60 krb5kdc[29698](info): commencing operation
krb5kdc: starting...
W20260810 03:45:36.297618 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:36 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:36Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.254.keytab.
Entry for principal oryx/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.254.keytab.
I20260810 03:45:36.436028 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:43561
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.254.keytab
--principal=oryx/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:43561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:36.562477 29711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:36.562800 29711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:36.562847 29711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:36.567516 29711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:36.567602 29711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:36.567624 29711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:36.567641 29711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:36.567656 29711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:36.573434 29711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:43561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.254.keytab
--principal=oryx/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:43561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:36.574491 29711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:36.575485 29711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:36.584487 29717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:36.584473 29719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:36.584580 29711 server_base.cc:1034] running on GCE node
W20260810 03:45:36.584475 29716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:36.585325 29711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:36.586503 29711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:36.587683 29711 hybrid_clock.cc:648] HybridClock initialized: now 1786333536587650 us; error 48 us; skew 500 ppm
Aug 10 03:45:36 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:36.590551 29711 init.cc:377] Logged in from keytab as oryx/127.22.134.254@KRBTEST.COM (short username oryx)
I20260810 03:45:36.591502 29711 webserver.cc:460] Webserver started at http://127.22.134.254:44245/ using document root <none> and password file <none>
I20260810 03:45:36.592047 29711 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:36.592128 29711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:36.592304 29711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:36.594496 29711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "920d4b792c7a4e2eadd5ac2718b98534"
format_stamp: "Formatted at 2026-08-10 03:45:36 on dist-test-slave-qg60"
server_key: "95563b94e01e170b1a3b78c5a695e506"
server_key_iv: "a3d79b74d836e9780af6e9c663f0a6b6"
server_key_version: "encryptionkey@0"
I20260810 03:45:36.595041 29711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "920d4b792c7a4e2eadd5ac2718b98534"
format_stamp: "Formatted at 2026-08-10 03:45:36 on dist-test-slave-qg60"
server_key: "95563b94e01e170b1a3b78c5a695e506"
server_key_iv: "a3d79b74d836e9780af6e9c663f0a6b6"
server_key_version: "encryptionkey@0"
I20260810 03:45:36.598932 29711 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:36.601449 29727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:36.602927 29711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:36.603073 29711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "920d4b792c7a4e2eadd5ac2718b98534"
format_stamp: "Formatted at 2026-08-10 03:45:36 on dist-test-slave-qg60"
server_key: "95563b94e01e170b1a3b78c5a695e506"
server_key_iv: "a3d79b74d836e9780af6e9c663f0a6b6"
server_key_version: "encryptionkey@0"
I20260810 03:45:36.603201 29711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:36.621028 29711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:36.624332 29711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:36.624552 29711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:36.632712 29711 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:43561
I20260810 03:45:36.632771 29785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:43561 every 8 connection(s)
I20260810 03:45:36.633893 29711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:36.636648 29786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:36.642268 29786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: Bootstrap starting.
I20260810 03:45:36.643452 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 29711
I20260810 03:45:36.643581 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:36.643886 23067 external_mini_cluster.cc:1428] Setting key bf7c11beca343d21301152ef8cbfcf2c
I20260810 03:45:36.645082 29786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:36.645921 29786 log.cc:824] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:36.647918 29786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: No bootstrap required, opened a new log
I20260810 03:45:36.652503 29786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } }
I20260810 03:45:36.652789 29786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:36.652874 29786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 920d4b792c7a4e2eadd5ac2718b98534, State: Initialized, Role: FOLLOWER
I20260810 03:45:36.653339 29786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } }
I20260810 03:45:36.653491 29786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:36.653580 29786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:36.653702 29786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 0 FOLLOWER]: Advancing to term 1
Aug 10 03:45:36 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:36.654875 29786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } }
I20260810 03:45:36.655299 29786 leader_election.cc:302] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 920d4b792c7a4e2eadd5ac2718b98534; no voters:
I20260810 03:45:36.655705 29786 leader_election.cc:288] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:36.655827 29791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:36.656157 29791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 1 LEADER]: Becoming Leader. State: Replica: 920d4b792c7a4e2eadd5ac2718b98534, State: Running, Role: LEADER
I20260810 03:45:36.656517 29791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } }
I20260810 03:45:36.657245 29786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:36.658311 29792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } }
I20260810 03:45:36.658457 29792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:36.658782 29793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 920d4b792c7a4e2eadd5ac2718b98534. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } }
I20260810 03:45:36.658862 29793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:36.659817 29801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:36.661336 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:36.645071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41800 (local address 127.22.134.254:43561)
0810 03:45:36.645585 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:36.645602 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:36.645639 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:45:36.646576 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:36.646603 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:36.646979 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:36.647321 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:36.648167 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:36.649690 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:36.650653 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:36.651493 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:36.651664 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:36.654618 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:36.654625 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:36.654642 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:36.654694 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:36.657022 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:36.657567 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:36.657573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:36.657580 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:36.657742 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:36.658115 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:36.658122 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:36.658126 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:36.658789 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:36.659690 (+ 901us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:36.659855 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 03:45:36.660348 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":174,"threads_started":1}
I20260810 03:45:36.663074 29801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:36.668373 29801 catalog_manager.cc:1347] Generated new cluster ID: d0b839249aaa4de3b8ef530ff86925d0
I20260810 03:45:36.668453 29801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:36.695315 29801 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:36.696679 29801 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:36.714560 29801 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: Generated new TSK 0
I20260810 03:45:36.715309 29801 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab.
Entry for principal oryx/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab.
I20260810 03:45:36.756701 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43561
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab
--principal=oryx/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:36.869630 29813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:36.869901 29813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:36.869946 29813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:36.874032 29813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:36.874094 29813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:36.874172 29813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:36.879576 29813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab
--principal=oryx/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:36.880627 29813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:36.881707 29813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:36.891503 29820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:36.891506 29821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:36.891534 29823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:36.891896 29813 server_base.cc:1034] running on GCE node
I20260810 03:45:36.892289 29813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:36.892992 29813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:36.894161 29813 hybrid_clock.cc:648] HybridClock initialized: now 1786333536894132 us; error 40 us; skew 500 ppm
Aug 10 03:45:36 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:36.897049 29813 init.cc:377] Logged in from keytab as oryx/127.22.134.193@KRBTEST.COM (short username oryx)
I20260810 03:45:36.897953 29813 webserver.cc:460] Webserver started at http://127.22.134.193:33521/ using document root <none> and password file <none>
I20260810 03:45:36.898566 29813 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:36.898630 29813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:36.898854 29813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:36.900964 29813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "59ba3b64635d487cbe632425bf9ff110"
format_stamp: "Formatted at 2026-08-10 03:45:36 on dist-test-slave-qg60"
server_key: "bbd51bb9feb585aa3279dc1927f13126"
server_key_iv: "4fd6242652cb9a86aa65b47d515426c5"
server_key_version: "encryptionkey@0"
I20260810 03:45:36.901543 29813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "59ba3b64635d487cbe632425bf9ff110"
format_stamp: "Formatted at 2026-08-10 03:45:36 on dist-test-slave-qg60"
server_key: "bbd51bb9feb585aa3279dc1927f13126"
server_key_iv: "4fd6242652cb9a86aa65b47d515426c5"
server_key_version: "encryptionkey@0"
I20260810 03:45:36.905512 29813 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:45:36.908253 29834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:36.909621 29813 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:45:36.909780 29813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "59ba3b64635d487cbe632425bf9ff110"
format_stamp: "Formatted at 2026-08-10 03:45:36 on dist-test-slave-qg60"
server_key: "bbd51bb9feb585aa3279dc1927f13126"
server_key_iv: "4fd6242652cb9a86aa65b47d515426c5"
server_key_version: "encryptionkey@0"
I20260810 03:45:36.909905 29813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:36.931613 29813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:36.934728 29813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:36.934945 29813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:36.935562 29813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:36.936427 29813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:36.936501 29813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:36.936575 29813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:36.936620 29813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:36.945878 29813 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:42133
I20260810 03:45:36.945904 29959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:42133 every 8 connection(s)
I20260810 03:45:36.946820 29813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:36.954578 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 29813
I20260810 03:45:36.954694 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:36.955032 23067 external_mini_cluster.cc:1428] Setting key 91ff3193d49faf801853f6330ddb1b0c
Aug 10 03:45:36 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:36.963564 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:36.949011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:41479 (local address 127.22.134.254:43561)
0810 03:45:36.949163 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:36.949167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:36.950128 (+ 961us) server_negotiation.cc:407] Connection header received
0810 03:45:36.951571 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:36.951575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:36.951638 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:36.951749 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:36.953044 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:36.953591 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:36.954991 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:36.955290 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:36.955405 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:36.958934 (+ 3529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:36.958938 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:36.958940 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:36.958964 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:36.960977 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:36.961584 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:36.961591 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:36.961596 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:36.961696 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:36.962056 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:36.962062 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:36.962067 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:36.962371 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:36.962485 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:36.963143 (+ 658us) server_negotiation.cc:299] Negotiation successful
0810 03:45:36.963312 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:36.964246 29962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:36.949475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:41479)
0810 03:45:36.949959 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:36.950003 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:36.951338 (+ 1335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:36.951933 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:36.951940 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:36.952316 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:36.952889 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:36.952904 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:36.953731 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:36.953734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:36.954867 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:36.954877 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:36.955453 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:36.955457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:36.955682 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:36.956424 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:36.956440 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:36.958740 (+ 2300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:36.961137 (+ 2397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:36.961144 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:36.961159 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:36.961459 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:36.961793 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:36.961796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:36.961797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:36.961949 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:36.962497 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:36.962503 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:36.962863 (+ 360us) client_negotiation.cc:769] Sending connection context
0810 03:45:36.963035 (+ 172us) client_negotiation.cc:240] Negotiation successful
0810 03:45:36.963380 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":129,"threads_started":1}
I20260810 03:45:36.965746 29960 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43561
I20260810 03:45:36.965992 29960 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:36.966553 29960 heartbeater.cc:511] Master 127.22.134.254:43561 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:36.968155 29743 ts_manager.cc:194] Registered new tserver with Master: 59ba3b64635d487cbe632425bf9ff110 (127.22.134.193:42133)
I20260810 03:45:36.969427 29743 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:41479
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab.
Entry for principal oryx/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab.
I20260810 03:45:36.988678 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43561
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab
--principal=oryx/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:37.110491 29965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:37.110795 29965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:37.110841 29965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:37.115597 29965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:37.115687 29965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:37.115793 29965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:37.122324 29965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab
--principal=oryx/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:37.123584 29965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:37.124722 29965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:37.135483 29976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:37.135426 29971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:37.135447 29972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:37.135998 29965 server_base.cc:1034] running on GCE node
I20260810 03:45:37.136454 29965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:37.137281 29965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:37.138475 29965 hybrid_clock.cc:648] HybridClock initialized: now 1786333537138457 us; error 31 us; skew 500 ppm
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:37.141716 29965 init.cc:377] Logged in from keytab as oryx/127.22.134.194@KRBTEST.COM (short username oryx)
I20260810 03:45:37.142681 29965 webserver.cc:460] Webserver started at http://127.22.134.194:40027/ using document root <none> and password file <none>
I20260810 03:45:37.143296 29965 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:37.143363 29965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:37.143635 29965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:37.145962 29965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "b8dc07c362654e9c9d7063e080866e89"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e40059eb4382110afd6d295e4b3330a1"
server_key_iv: "0b09eb897373b937fe3542232e302160"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.146624 29965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "b8dc07c362654e9c9d7063e080866e89"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e40059eb4382110afd6d295e4b3330a1"
server_key_iv: "0b09eb897373b937fe3542232e302160"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.150905 29965 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:37.153594 29985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.154963 29965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:45:37.155107 29965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "b8dc07c362654e9c9d7063e080866e89"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e40059eb4382110afd6d295e4b3330a1"
server_key_iv: "0b09eb897373b937fe3542232e302160"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.155232 29965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:37.174532 29965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:37.178306 29965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:37.178547 29965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:37.179201 29965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:37.180275 29965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:37.180354 29965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.180437 29965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:37.180503 29965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.190706 29965 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:40889
I20260810 03:45:37.190734 30113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:40889 every 8 connection(s)
I20260810 03:45:37.191761 29965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:37.197072 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 29965
I20260810 03:45:37.197212 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:37.197537 23067 external_mini_cluster.cc:1428] Setting key ce2a73c169a83b20d747037461191a8b
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:45:37.209200 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.193918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:57489 (local address 127.22.134.254:43561)
0810 03:45:37.194062 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.194066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.195015 (+ 949us) server_negotiation.cc:407] Connection header received
0810 03:45:37.196427 (+ 1412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.196430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.196490 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.196602 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.198221 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.198994 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.200840 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.201076 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.201176 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.204546 (+ 3370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.204551 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.204556 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.204596 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.206441 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.207234 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.207239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.207243 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.207377 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.207815 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.207820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.207822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.208052 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.208174 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.208818 (+ 644us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.209005 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:45:37.210348 30116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.194360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:57489)
0810 03:45:37.194863 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:37.194908 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:37.196207 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:37.196816 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:37.196825 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:37.197359 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:37.198039 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.198056 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.199165 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.199170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.200650 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.200665 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.201262 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.201267 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.201537 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.202259 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:37.202277 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:37.204291 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:37.206633 (+ 2342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.206641 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.206669 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.207101 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.207519 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.207523 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.207525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.207698 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.208189 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:37.208200 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:37.208502 (+ 302us) client_negotiation.cc:769] Sending connection context
0810 03:45:37.208719 (+ 217us) client_negotiation.cc:240] Negotiation successful
0810 03:45:37.209195 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":134,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.195@KRBTEST.COM" created.
I20260810 03:45:37.211992 30114 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43561
I20260810 03:45:37.212285 30114 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:37.212983 30114 heartbeater.cc:511] Master 127.22.134.254:43561 requested a full tablet report, sending...
I20260810 03:45:37.214337 29743 ts_manager.cc:194] Registered new tserver with Master: b8dc07c362654e9c9d7063e080866e89 (127.22.134.194:40889)
I20260810 03:45:37.215093 29743 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:57489
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab.
Entry for principal oryx/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab.
I20260810 03:45:37.233448 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43561
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab
--principal=oryx/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:37.350359 30119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:37.350666 30119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:37.350710 30119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:37.354743 30119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:37.354812 30119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:37.354871 30119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:37.360832 30119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab
--principal=oryx/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:37.361986 30119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:37.363041 30119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:37.372848 30124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:37.372946 30119 server_base.cc:1034] running on GCE node
W20260810 03:45:37.372848 30127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:37.372869 30125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:37.373497 30119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:37.374130 30119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:37.375334 30119 hybrid_clock.cc:648] HybridClock initialized: now 1786333537375320 us; error 24 us; skew 500 ppm
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:37.378160 30119 init.cc:377] Logged in from keytab as oryx/127.22.134.195@KRBTEST.COM (short username oryx)
I20260810 03:45:37.379105 30119 webserver.cc:460] Webserver started at http://127.22.134.195:45283/ using document root <none> and password file <none>
I20260810 03:45:37.379691 30119 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:37.379786 30119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:37.380025 30119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:37.382328 30119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "9c40d4d1baba47fb929dde9445e76f40"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "6812389695825d73b9a15c0f67224e56"
server_key_iv: "aa89f2a6f579a7f4bb28f004c05c07e8"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.382907 30119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "9c40d4d1baba47fb929dde9445e76f40"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "6812389695825d73b9a15c0f67224e56"
server_key_iv: "aa89f2a6f579a7f4bb28f004c05c07e8"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.386827 30119 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:37.389307 30138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.390539 30119 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:45:37.390673 30119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "9c40d4d1baba47fb929dde9445e76f40"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "6812389695825d73b9a15c0f67224e56"
server_key_iv: "aa89f2a6f579a7f4bb28f004c05c07e8"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.390798 30119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:37.405006 30119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:37.408151 30119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:37.408356 30119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:37.409014 30119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:37.409850 30119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:37.409920 30119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.409992 30119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:37.410045 30119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.419612 30119 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:37497
I20260810 03:45:37.419631 30264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:37497 every 8 connection(s)
I20260810 03:45:37.420624 30119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:37.421684 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 30119
I20260810 03:45:37.421813 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:37.422158 23067 external_mini_cluster.cc:1428] Setting key 423812bcbfa87759938b76254d08647c
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:37.434463 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.422942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:37297 (local address 127.22.134.254:43561)
0810 03:45:37.423096 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.423101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.423896 (+ 795us) server_negotiation.cc:407] Connection header received
0810 03:45:37.425351 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.425354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.425401 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.425471 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.426643 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.427224 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.428327 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.428561 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.428661 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.431171 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.431175 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.431178 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.431205 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.432475 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.433043 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.433046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.433048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.433122 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.433432 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.433435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.433436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.433608 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.433689 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.434230 (+ 541us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.434333 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:45:37.435822 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.423235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:37297)
0810 03:45:37.423746 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:37.423801 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:37.425151 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:37.425632 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:37.425639 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:37.425995 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:37.426494 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.426507 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.427330 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.427333 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.428184 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.428192 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.428704 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.428707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.428868 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.429467 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:37.429483 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:37.430998 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:37.432602 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.432612 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.432626 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.432955 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.433207 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.433209 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.433211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.433348 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.433734 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:37.433740 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:37.433993 (+ 253us) client_negotiation.cc:769] Sending connection context
0810 03:45:37.434174 (+ 181us) client_negotiation.cc:240] Negotiation successful
0810 03:45:37.434508 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":168,"threads_started":1}
I20260810 03:45:37.437110 30265 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43561
I20260810 03:45:37.437398 30265 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:37.437974 30265 heartbeater.cc:511] Master 127.22.134.254:43561 requested a full tablet report, sending...
I20260810 03:45:37.439160 29743 ts_manager.cc:194] Registered new tserver with Master: 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497)
I20260810 03:45:37.439766 29743 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:37297
I20260810 03:45:37.448504 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.134.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.253.keytab.
Entry for principal oryx/127.22.134.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.253.keytab.
I20260810 03:45:37.477840 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.253:44595
--webserver_interface=127.22.134.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.253.keytab
--principal=oryx/127.22.134.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:43561,127.22.134.253:44595
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:37.594426 30270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:37.594770 30270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:37.594842 30270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:37.599092 30270 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:37.599182 30270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:37.599203 30270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:37.599221 30270 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:37.599236 30270 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:37.605130 30270 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:43561,127.22.134.253:44595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.253.keytab
--principal=oryx/127.22.134.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.253:44595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.134.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
W20260810 03:45:37.605376 30270 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.22.134.254:43561,127.22.134.253:44595'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 03:45:37.606367 30270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:37.607537 30270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:37.617188 30275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:37.617302 30270 server_base.cc:1034] running on GCE node
W20260810 03:45:37.617127 30276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:37.617125 30279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:37.618052 30270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:37.619360 30270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:37.620749 30270 hybrid_clock.cc:648] HybridClock initialized: now 1786333537620573 us; error 51 us; skew 500 ppm
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:37.623896 30270 init.cc:377] Logged in from keytab as oryx/127.22.134.253@KRBTEST.COM (short username oryx)
I20260810 03:45:37.625041 30270 webserver.cc:460] Webserver started at http://127.22.134.253:35423/ using document root <none> and password file <none>
I20260810 03:45:37.625654 30270 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:37.625890 30270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:37.626327 30270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:37.628603 30270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data/instance:
uuid: "4c104723ad384a28a4b4e73d08ee6309"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "8504913f06cadcde83409aee5d5219f4"
server_key_iv: "65d435843b10103f54974424dcb2116b"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.629280 30270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal/instance:
uuid: "4c104723ad384a28a4b4e73d08ee6309"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "8504913f06cadcde83409aee5d5219f4"
server_key_iv: "65d435843b10103f54974424dcb2116b"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.633347 30270 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:37.636098 30287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.637507 30270 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:37.637660 30270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
uuid: "4c104723ad384a28a4b4e73d08ee6309"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "8504913f06cadcde83409aee5d5219f4"
server_key_iv: "65d435843b10103f54974424dcb2116b"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.637796 30270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:37.656663 30270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:37.660318 30270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:37.660545 30270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:37.667930 30270 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.253:44595
I20260810 03:45:37.668262 30349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.253:44595 every 8 connection(s)
I20260810 03:45:37.669108 30270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
I20260810 03:45:37.672015 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:37.675494 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 30270
I20260810 03:45:37.675850 30350 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.253@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.134.253@KRBTEST.COM
I20260810 03:45:37.688658 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.677879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41804 (local address 127.22.134.254:43561)
0810 03:45:37.678028 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.678033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.678377 (+ 344us) server_negotiation.cc:407] Connection header received
0810 03:45:37.678804 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.678807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.678851 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.678925 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.679927 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.680456 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.681671 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.681938 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.682020 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.684962 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.684965 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.684967 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.684992 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.686639 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.687165 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.687168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.687170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.687262 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.687589 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.687593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.687595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.687831 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.687945 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.688346 (+ 401us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.688472 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:45:37.689845 30354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.677790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:41804)
0810 03:45:37.678215 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:37.678270 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:37.678587 (+ 317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:37.679011 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:37.679016 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:37.679460 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:37.679770 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.679783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.680588 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.680591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.681555 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.681565 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.682081 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.682085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.682268 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.683112 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:37.683128 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:37.684758 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:37.686776 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.686785 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.686796 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.687047 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.687359 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.687362 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.687364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.687490 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.687956 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:37.687965 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:37.688119 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 03:45:37.688288 (+ 169us) client_negotiation.cc:240] Negotiation successful
0810 03:45:37.689044 (+ 756us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":4,"spinlock_wait_cycles":3328,"thread_start_us":150,"threads_started":1}
I20260810 03:45:37.689845 30353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.677177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34698 (local address 127.22.134.253:44595)
0810 03:45:37.677629 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.677643 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.677678 (+ 35us) server_negotiation.cc:407] Connection header received
0810 03:45:37.678587 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.678609 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.678836 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.679040 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.679770 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.680794 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.681781 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.682219 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.682317 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.685332 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.685341 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.685358 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.685379 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.686877 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.687325 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.687331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.687332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.687441 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.687743 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.687746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.687748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.688108 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.688331 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.688507 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.689100 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":484,"server-negotiator.queue_time_us":320,"spinlock_wait_cycles":1280,"thread_start_us":163,"threads_started":1}
I20260810 03:45:37.691346 30350 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.253@KRBTEST.COM for oryx/127.22.134.253@KRBTEST.COM
I20260810 03:45:37.699031 30353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.691933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34710 (local address 127.22.134.253:44595)
0810 03:45:37.692052 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.692056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.692069 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:37.692160 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.692163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.692215 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.692310 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.692668 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.693242 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.694054 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.694269 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.694378 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.696348 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.696351 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.696352 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.696373 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.697637 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.698045 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.698048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.698049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.698123 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.698367 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.698369 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.698370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.698532 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.698603 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.698824 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.698910 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:45:37.699047 30354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.691883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.0.0.1:34710)
0810 03:45:37.691977 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:37.691993 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:37.692069 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:37.692319 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:37.692321 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:37.692480 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:37.692562 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.692567 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.693347 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.693354 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.693887 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.693895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.694377 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.694380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.694473 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.694885 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:37.694895 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:37.696221 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:37.697740 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.697743 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.697744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.697931 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.698209 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.698211 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.698212 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.698289 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.698609 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:37.698611 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:37.698691 (+ 80us) client_negotiation.cc:769] Sending connection context
0810 03:45:37.698770 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 03:45:37.698869 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 03:45:37.702503 30350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Bootstrap starting.
I20260810 03:45:37.704938 30350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:37.705703 30350 log.cc:824] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:37.707779 30350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: No bootstrap required, opened a new log
I20260810 03:45:37.710886 30350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } }
I20260810 03:45:37.711097 30350 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:37.711179 30350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c104723ad384a28a4b4e73d08ee6309, State: Initialized, Role: FOLLOWER
I20260810 03:45:37.711640 30350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } }
I20260810 03:45:37.712147 30357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } } }
I20260810 03:45:37.712293 30357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:45:37.712973 30350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 03:45:37.717902 30368 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:37.717998 30368 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:37.720335 30357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:37.720489 30357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } }
I20260810 03:45:37.720499 30270 master_runner.cc:428] Detected that this master 4c104723ad384a28a4b4e73d08ee6309 is joining an existing cluster
I20260810 03:45:37.720646 30270 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.134.253:44595
I20260810 03:45:37.721310 30357 leader_election.cc:288] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561)
I20260810 03:45:37.721764 29757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4c104723ad384a28a4b4e73d08ee6309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "920d4b792c7a4e2eadd5ac2718b98534" is_pre_election: true
I20260810 03:45:37.722506 30294 leader_election.cc:302] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 4c104723ad384a28a4b4e73d08ee6309; no voters: 920d4b792c7a4e2eadd5ac2718b98534
I20260810 03:45:37.722765 30357 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 03:45:37.733139 30353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.723627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34726 (local address 127.22.134.253:44595)
0810 03:45:37.723748 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.723752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.724203 (+ 451us) server_negotiation.cc:407] Connection header received
0810 03:45:37.724327 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.724331 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.724384 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.724474 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.725019 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.725879 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.727864 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.728190 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.728324 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.729952 (+ 1628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.729958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.729962 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.729988 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.731341 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.731890 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.731893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.731894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.731975 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.732277 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.732280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.732282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.732449 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.732547 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.732820 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.732996 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":111,"server-negotiator.queue_time_us":51}
I20260810 03:45:37.733179 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.723634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41820 (local address 127.22.134.254:43561)
0810 03:45:37.723766 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.723771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.724221 (+ 450us) server_negotiation.cc:407] Connection header received
0810 03:45:37.724592 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.724595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.724643 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.724772 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.725296 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.725812 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.727225 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.727606 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.727740 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.729051 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.729057 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.729060 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.729088 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.730755 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.731761 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.731765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.731767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.731882 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.732193 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.732197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.732199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.732424 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.732521 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.732895 (+ 374us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.733015 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:37.733150 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.723833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.0.0.1:34726)
0810 03:45:37.724119 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:37.724132 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:37.724241 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:37.724494 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:37.724496 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:37.724690 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:37.724887 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.724898 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.725978 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.725981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.727084 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.727096 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.728432 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.728436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.728524 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.729402 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:37.729416 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:37.729826 (+ 410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:37.731449 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.731452 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.731454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.731789 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.732070 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.732073 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.732075 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.732151 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.732548 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:37.732551 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:37.732631 (+ 80us) client_negotiation.cc:769] Sending connection context
0810 03:45:37.732767 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 03:45:37.732940 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":158,"thread_start_us":104,"threads_started":1}
I20260810 03:45:37.733795 30376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.723570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:41820)
0810 03:45:37.724106 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:37.724123 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:37.724237 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:37.724798 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:37.724801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:37.725015 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:37.725180 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.725185 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.725919 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.725924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.727085 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.727096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.727773 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.727776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.727842 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.728414 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:37.728426 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:37.728854 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:37.731429 (+ 2575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.731431 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.731432 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.731649 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.732013 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.732019 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.732021 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.732107 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.732567 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:37.732570 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:37.732671 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 03:45:37.733459 (+ 788us) client_negotiation.cc:240] Negotiation successful
0810 03:45:37.733601 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":139,"spinlock_wait_cycles":896,"thread_start_us":114,"threads_started":1}
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.254@KRBTEST.COM for oryx/127.22.134.253@KRBTEST.COM
I20260810 03:45:37.749292 30353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.739426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34732 (local address 127.22.134.253:44595)
0810 03:45:37.739527 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.739530 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.739541 (+ 11us) server_negotiation.cc:407] Connection header received
0810 03:45:37.739596 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.739598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.739638 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.739723 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.740411 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.741018 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.741974 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.742377 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.742475 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.745484 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.745488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.745516 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.745546 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.747323 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.747827 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.747832 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.747834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.747921 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.748209 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.748213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.748215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.748404 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.748510 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.748988 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.749122 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 03:45:37.749428 30377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.738449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.0.0.1:34732)
0810 03:45:37.738936 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:37.739013 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:37.739218 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:37.739789 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:37.739796 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:37.740166 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:37.740289 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.740296 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.741113 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.741117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.741856 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.741866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.742616 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.742619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.742764 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.743371 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:37.743387 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:37.745325 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:37.747442 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.747453 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.747459 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.747717 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.748015 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.748019 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.748021 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.748114 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.748514 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:37.748524 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:37.748691 (+ 167us) client_negotiation.cc:769] Sending connection context
0810 03:45:37.748893 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 03:45:37.749157 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":128,"threads_started":1}
I20260810 03:45:37.751320 29743 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.134.253:44595: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309"
member_type: NON_VOTER
last_known_addr {
host: "127.22.134.253"
port: 44595
}
attrs {
promote: true
}
}
dest_uuid: "920d4b792c7a4e2eadd5ac2718b98534"
cas_config_opid_index: -1
I20260810 03:45:37.752128 29743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } }
I20260810 03:45:37.754499 30380 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } }
WARNING: no policy specified for oryx/127.22.134.252@KRBTEST.COM; defaulting to no policy
I20260810 03:45:37.755446 30318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:37.757800 30380 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.134.253:44595
I20260810 03:45:37.758127 30318 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Refusing update from remote peer 920d4b792c7a4e2eadd5ac2718b98534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 03:45:37.758155 30380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } }
I20260810 03:45:37.758266 30380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:37.758464 30270 master.cc:537] Master@127.22.134.253:44595 shutting down...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.252@KRBTEST.COM" created.
I20260810 03:45:37.759382 30380 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:45:37.761415 29728 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260810 03:45:37.763325 29728 consensus_peers.cc:487] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 -> Peer 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253:44595): Couldn't send request to peer 4c104723ad384a28a4b4e73d08ee6309. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 03:45:37.764935 30270 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:37.765219 30270 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:37.765332 30270 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.252.keytab.
Entry for principal oryx/127.22.134.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.252.keytab.
I20260810 03:45:37.780380 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.252:43203
--webserver_interface=127.22.134.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.252.keytab
--principal=oryx/127.22.134.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:43561,127.22.134.253:44595,127.22.134.252:43203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:45:37.781097 30270 master.cc:552] Master@127.22.134.253:44595 shutdown complete.
I20260810 03:45:37.781172 30270 master_runner.cc:305] Clearing existing system tablet
I20260810 03:45:37.781502 30270 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:37.781579 30270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:37.782882 30270 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:37.783907 30388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.784195 30270 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:37.784373 30270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:37.784411 30270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
uuid: "4c104723ad384a28a4b4e73d08ee6309"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "8504913f06cadcde83409aee5d5219f4"
server_key_iv: "65d435843b10103f54974424dcb2116b"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.787235 30270 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:37.790598 30270 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 03:45:37.790735 30270 log.cc:1196] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 03:45:37.791038 30270 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Deleting consensus metadata
I20260810 03:45:37.791267 30270 master_runner.cc:315] Copying system tablet from 127.22.134.254:43561
I20260810 03:45:37.792979 30270 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: tablet copy: Beginning tablet copy session from remote peer at address 127.22.134.254:43561
I20260810 03:45:37.802707 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.793633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:41826)
0810 03:45:37.793995 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:37.794011 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:37.794135 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:37.794578 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:37.794581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:37.794826 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:37.794958 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.794965 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.796157 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.796161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.797140 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:37.797151 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.797767 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.797770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:37.797868 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.798477 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:37.798492 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:37.798932 (+ 440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:37.800976 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.800979 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.800982 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.801244 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.801541 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:37.801544 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:37.801546 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:37.801640 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:37.802112 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:37.802116 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:37.802219 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 03:45:37.802328 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 03:45:37.802476 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":120,"threads_started":1}
I20260810 03:45:37.802724 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:37.793788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41826 (local address 127.22.134.254:43561)
0810 03:45:37.793956 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:37.793962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:37.794110 (+ 148us) server_negotiation.cc:407] Connection header received
0810 03:45:37.794307 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:37.794312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:37.794366 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:37.794422 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:37.795106 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.796022 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.797269 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:37.797621 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:37.797736 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:37.799083 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:37.799086 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:37.799090 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:37.799118 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:37.800859 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.801348 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.801352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.801354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.801444 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:37.801745 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:37.801748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:37.801750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:37.802003 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:37.802122 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:37.802423 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 03:45:37.802547 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:45:37.803383 29769 tablet_copy_service.cc:140] P 920d4b792c7a4e2eadd5ac2718b98534: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4c104723ad384a28a4b4e73d08ee6309 ({username='oryx', principal='oryx/127.22.134.253@KRBTEST.COM'} at 127.0.0.1:41826)
I20260810 03:45:37.803553 29769 tablet_copy_service.cc:161] P 920d4b792c7a4e2eadd5ac2718b98534: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4c104723ad384a28a4b4e73d08ee6309 at {username='oryx', principal='oryx/127.22.134.253@KRBTEST.COM'} at 127.0.0.1:41826: session id = 4c104723ad384a28a4b4e73d08ee6309-00000000000000000000000000000000
I20260810 03:45:37.805209 29769 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 03:45:37.807000 30270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 03:45:37.809532 30270 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: tablet copy: Starting download of 0 data blocks...
I20260810 03:45:37.809754 30270 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: tablet copy: Starting download of 1 WAL segments...
I20260810 03:45:37.811715 30270 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 03:45:37.813805 29769 tablet_copy_service.cc:342] P 920d4b792c7a4e2eadd5ac2718b98534: Request end of tablet copy session 4c104723ad384a28a4b4e73d08ee6309-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.134.253@KRBTEST.COM'} at 127.0.0.1:41826
I20260810 03:45:37.813917 29769 tablet_copy_service.cc:433] P 920d4b792c7a4e2eadd5ac2718b98534: ending tablet copy session 4c104723ad384a28a4b4e73d08ee6309-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4c104723ad384a28a4b4e73d08ee6309
I20260810 03:45:37.822147 30270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:37.823980 30395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:37.824059 30398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:37.824365 30396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:37.824550 30270 server_base.cc:1034] running on GCE node
I20260810 03:45:37.824863 30270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:37.825168 30270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:37.826314 30270 hybrid_clock.cc:648] HybridClock initialized: now 1786333537826302 us; error 30 us; skew 500 ppm
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:37.828083 30270 init.cc:377] Logged in from keytab as oryx/127.22.134.253@KRBTEST.COM (short username oryx)
I20260810 03:45:37.828570 30270 webserver.cc:460] Webserver started at http://127.22.134.253:32859/ using document root <none> and password file <none>
I20260810 03:45:37.828835 30270 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:37.828886 30270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:37.830271 30270 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:37.831405 30406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.831666 30270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:37.831792 30270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
uuid: "4c104723ad384a28a4b4e73d08ee6309"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "8504913f06cadcde83409aee5d5219f4"
server_key_iv: "65d435843b10103f54974424dcb2116b"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.831943 30270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:37.857571 30270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:37.860472 30270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:37.866860 30270 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.253:44595
I20260810 03:45:37.866889 30464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.253:44595 every 8 connection(s)
I20260810 03:45:37.867727 30270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
I20260810 03:45:37.869972 30465 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:45:37.871042 30465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Bootstrap starting.
I20260810 03:45:37.882335 30465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:45:37.882745 30465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: Bootstrap complete.
I20260810 03:45:37.883438 30465 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } }
I20260810 03:45:37.883591 30465 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4c104723ad384a28a4b4e73d08ee6309, State: Initialized, Role: LEARNER
I20260810 03:45:37.883709 30465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } }
I20260810 03:45:37.884080 30470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } }
I20260810 03:45:37.884224 30465 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:37.884275 30470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: This master's current role is: LEARNER
I20260810 03:45:37.888865 30482 catalog_manager.cc:1259] Loaded cluster ID: d0b839249aaa4de3b8ef530ff86925d0
I20260810 03:45:37.889050 30482 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: loading cluster ID for follower catalog manager: success
I20260810 03:45:37.891439 30482 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: acquiring CA information for follower catalog manager: success
I20260810 03:45:37.892882 30482 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 03:45:37.922969 30386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:37.923313 30386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:37.923418 30386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:37.927608 30386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:37.927721 30386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:37.927764 30386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:37.927804 30386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:37.927839 30386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:37.933825 30386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:43561,127.22.134.253:44595,127.22.134.252:43203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.252.keytab
--principal=oryx/127.22.134.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.252:43203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.134.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:37.935029 30386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:37.936115 30386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:37.945902 30488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:37.945986 30490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:37.946069 30386 server_base.cc:1034] running on GCE node
W20260810 03:45:37.945922 30487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:37.946897 30386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:37.948089 30386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:37.949343 30386 hybrid_clock.cc:648] HybridClock initialized: now 1786333537949322 us; error 36 us; skew 500 ppm
Aug 10 03:45:37 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:37.952911 30386 init.cc:377] Logged in from keytab as oryx/127.22.134.252@KRBTEST.COM (short username oryx)
I20260810 03:45:37.953961 30386 webserver.cc:460] Webserver started at http://127.22.134.252:37083/ using document root <none> and password file <none>
I20260810 03:45:37.954593 30386 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:37.954674 30386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:37.954875 30386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:37.957495 30386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data/instance:
uuid: "5ceac01c98f24112b930a35ee1144d4d"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e05251c6356020d0ff56e51d65a3f1ed"
server_key_iv: "5db17c4d072da9d12cd2f557ffe04e69"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.958529 30386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal/instance:
uuid: "5ceac01c98f24112b930a35ee1144d4d"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e05251c6356020d0ff56e51d65a3f1ed"
server_key_iv: "5db17c4d072da9d12cd2f557ffe04e69"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.963936 30386 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 03:45:37.967012 30498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:37.968387 30386 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 03:45:37.968551 30386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
uuid: "5ceac01c98f24112b930a35ee1144d4d"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e05251c6356020d0ff56e51d65a3f1ed"
server_key_iv: "5db17c4d072da9d12cd2f557ffe04e69"
server_key_version: "encryptionkey@0"
I20260810 03:45:37.968695 30386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:37.972559 29960 heartbeater.cc:503] Master 127.22.134.254:43561 was elected leader, sending a full tablet report...
I20260810 03:45:37.990916 30386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:37.994694 30386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:37.994958 30386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:38.007548 30386 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.252:43203
I20260810 03:45:38.007863 30556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.252:43203 every 8 connection(s)
I20260810 03:45:38.009044 30386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
I20260810 03:45:38.010792 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 30386
I20260810 03:45:38.012609 30557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:38.018036 30557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.134.252@KRBTEST.COM
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.252@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:38.029982 30559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.012685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60356 (local address 127.22.134.252:43203)
0810 03:45:38.013504 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.013522 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.013565 (+ 43us) server_negotiation.cc:407] Connection header received
0810 03:45:38.014622 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.014644 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.015010 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.015346 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.016487 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.018184 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.019340 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.019865 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.020149 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.023270 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.023276 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.023286 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.023314 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.025672 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.026281 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.026287 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.026293 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.026418 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.026819 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.026822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.026824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.027542 (+ 718us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.027713 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.028244 (+ 531us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.028623 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":410,"threads_started":1}
I20260810 03:45:38.032230 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.020261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41842 (local address 127.22.134.254:43561)
0810 03:45:38.020431 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.020436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.020991 (+ 555us) server_negotiation.cc:407] Connection header received
0810 03:45:38.021141 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.021145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.021208 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.021310 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.022287 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.022899 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.024374 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.024647 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.024810 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.028075 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.028079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.028081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.028112 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.029947 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.030785 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.030789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.030791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.030884 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.031197 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.031200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.031202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.031400 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.031517 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.031853 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.032089 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 03:45:38.032214 30560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.020124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:41842)
0810 03:45:38.020816 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.020863 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.021030 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.021368 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.021374 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.021772 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.022055 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.022068 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.023111 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.023119 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.024227 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.024239 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.024855 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.024859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.025054 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.025619 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.025632 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.027801 (+ 2169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.030345 (+ 2544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.030358 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.030364 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.030650 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.030989 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.030994 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.030998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.031091 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.031520 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.031528 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.031645 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.031793 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.031997 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"spinlock_wait_cycles":28416,"thread_start_us":257,"threads_started":1}
I20260810 03:45:38.033931 30557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.252@KRBTEST.COM for oryx/127.22.134.253@KRBTEST.COM
I20260810 03:45:38.044116 30560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.034615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.0.0.1:34746)
0810 03:45:38.034788 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.034804 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.034914 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.035392 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.035395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.035555 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.035756 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.035761 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.036824 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.036827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.037395 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.037402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.037878 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.037882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.038013 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.038658 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.038671 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.040287 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.042442 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.042446 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.042448 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.042677 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.043005 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.043009 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.043011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.043096 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.043534 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.043537 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.043647 (+ 110us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.043763 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.043928 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260810 03:45:38.044118 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.034797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34746 (local address 127.22.134.253:44595)
0810 03:45:38.035152 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.035156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.035171 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:45:38.035214 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.035217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.035260 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.035345 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.035907 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.036617 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.037508 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.037746 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.037830 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.040430 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.040433 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.040435 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.040456 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.042289 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.042793 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.042798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.042799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.042902 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.043198 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.043203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.043205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.043421 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.043543 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.043819 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.043949 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":122,"threads_started":1}
I20260810 03:45:38.045282 30557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333537, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.252@KRBTEST.COM for oryx/127.22.134.252@KRBTEST.COM
I20260810 03:45:38.054569 30559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.046077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60368 (local address 127.22.134.252:43203)
0810 03:45:38.046190 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.046194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.046209 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:45:38.046277 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.046280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.046318 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.046408 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.046774 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.047754 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.048574 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.048913 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.049041 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.051281 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.051285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.051287 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.051310 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.052795 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.053240 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.053245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.053247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.053328 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.053627 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.053630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.053632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.053881 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.053990 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.054245 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.054411 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":108,"server-negotiator.queue_time_us":53}
I20260810 03:45:38.054569 30560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.045930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:43203 (local address 127.0.0.1:60368)
0810 03:45:38.046042 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.046057 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.046182 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.046419 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.046422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.046594 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.046663 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.046668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.047891 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.047897 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.048452 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.048459 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.049038 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.049041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.049152 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.049668 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.049680 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.051146 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.052931 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.052935 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.052937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.053142 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.053425 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.053428 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.053430 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.053507 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.053988 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.053991 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.054086 (+ 95us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.054201 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.054355 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":1}
I20260810 03:45:38.058171 30557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Bootstrap starting.
I20260810 03:45:38.061125 30557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:38.062235 30557 log.cc:824] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:38.064348 30557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: No bootstrap required, opened a new log
I20260810 03:45:38.068320 30557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } }
I20260810 03:45:38.068588 30557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:38.068681 30557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ceac01c98f24112b930a35ee1144d4d, State: Initialized, Role: FOLLOWER
I20260810 03:45:38.069180 30557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } }
I20260810 03:45:38.069758 30563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } } }
I20260810 03:45:38.069936 30563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:45:38.070487 30557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: configured and running, proceeding with master startup.
W20260810 03:45:38.076502 30574 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:38.076606 30574 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:38.080556 30386 master_runner.cc:428] Detected that this master 5ceac01c98f24112b930a35ee1144d4d is joining an existing cluster
I20260810 03:45:38.080647 30386 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.134.252:43203
I20260810 03:45:38.083760 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 29813
I20260810 03:45:38.099424 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.084361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41850 (local address 127.22.134.254:43561)
0810 03:45:38.084896 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.084902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.085833 (+ 931us) server_negotiation.cc:407] Connection header received
0810 03:45:38.086070 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.086076 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.086145 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.086214 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.087325 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.088195 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.089849 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.090378 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.090504 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.093171 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.093179 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.093186 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.093228 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.095622 (+ 2394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.096302 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.096306 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.096308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.096413 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.097541 (+ 1128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.097545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.097547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.097803 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.097933 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.098930 (+ 997us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.099090 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420}
I20260810 03:45:38.100188 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.084002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:41850)
0810 03:45:38.085711 (+ 1709us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.085733 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.085929 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.086414 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.086419 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.086861 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.087135 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.087150 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.088340 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.088347 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.089656 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.089672 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.090768 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.090775 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.090925 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.092201 (+ 1276us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.092225 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.092952 (+ 727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.095806 (+ 2854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.095821 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.095826 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.096138 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.096536 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.096543 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.096547 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.096697 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.098519 (+ 1822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.098533 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.098712 (+ 179us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.099708 (+ 996us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.099866 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1534,"thread_start_us":199,"threads_started":1}
I20260810 03:45:38.106529 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:42133
--local_ip_for_outbound_sockets=127.22.134.193
--tserver_master_addrs=127.22.134.254:43561
--webserver_port=33521
--webserver_interface=127.22.134.193
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab
--principal=oryx/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595,127.22.134.252:43203 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333536, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.254@KRBTEST.COM for oryx/127.22.134.252@KRBTEST.COM
I20260810 03:45:38.129866 30377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.104446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:43203 (local address 127.0.0.1:60386)
0810 03:45:38.104638 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.104653 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.104736 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.105279 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.105282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.105479 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.105569 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.105574 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.106532 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.106536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.107495 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.107506 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.108180 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.108184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.108296 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.108936 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.108954 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.110682 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.127837 (+ 17155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.127842 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.127844 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.128152 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.128503 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.128507 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.128510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.128622 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.129277 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.129280 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.129400 (+ 120us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.129487 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.129676 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260810 03:45:38.130954 30584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.104625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60386 (local address 127.22.134.252:43203)
0810 03:45:38.105032 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.105039 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.105049 (+ 10us) server_negotiation.cc:407] Connection header received
0810 03:45:38.105106 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.105108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.105147 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.105257 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.105687 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.106407 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.107632 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.108038 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.108163 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.110894 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.110901 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.110905 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.110939 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.127663 (+ 16724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.128291 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.128294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.128295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.128385 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.128770 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.128773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.128775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.129147 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.130518 (+ 1371us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.130631 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.130765 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":164,"threads_started":1}
I20260810 03:45:38.131408 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.084482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.0.0.1:34758)
0810 03:45:38.085801 (+ 1319us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.085845 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.085941 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.097816 (+ 11875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.097822 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.098147 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.098360 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.098372 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.101658 (+ 3286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.101663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.103019 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.103034 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.103941 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.103945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.104049 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.104529 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.104869 (+ 340us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.125612 (+ 20743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.129748 (+ 4136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.129751 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.129753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.129976 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.130324 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.130327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.130329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.130413 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.130883 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.130886 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.130980 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.131081 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.131235 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"thread_start_us":137,"threads_started":1}
I20260810 03:45:38.132014 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.097230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34758 (local address 127.22.134.253:44595)
0810 03:45:38.097412 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.097418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.097436 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:45:38.097490 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.097496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.097568 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.097656 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.100709 (+ 3053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.101501 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.103173 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.103644 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.103741 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.125877 (+ 22136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.125882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.125885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.125921 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.127697 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.130096 (+ 2399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.130100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.130102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.130211 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.130512 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.130516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.130517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.130745 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.130839 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.131726 (+ 887us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.131865 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 03:45:38.133347 29743 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.134.252:43203: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d"
member_type: NON_VOTER
last_known_addr {
host: "127.22.134.252"
port: 43203
}
attrs {
promote: true
}
}
dest_uuid: "920d4b792c7a4e2eadd5ac2718b98534"
cas_config_opid_index: 5
I20260810 03:45:38.133926 30559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.085098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60380 (local address 127.22.134.252:43203)
0810 03:45:38.085215 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.085219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.098294 (+ 13075us) server_negotiation.cc:407] Connection header received
0810 03:45:38.098436 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.098438 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.098472 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.098516 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.099123 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.099902 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.101069 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.101399 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.101485 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.126838 (+ 25353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.126842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.126845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.126873 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.129649 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.132791 (+ 3142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.132795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.132797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.132872 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.133118 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.133121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.133123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.133317 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.133406 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.133673 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.133786 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:45:38.133981 29743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } }
I20260810 03:45:38.134450 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.085204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:43203 (local address 127.0.0.1:60380)
0810 03:45:38.098192 (+ 12988us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.098210 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.098349 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.098627 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.098630 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.098877 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.099004 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.099011 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.100017 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.100020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.100919 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.100929 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.101621 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.101625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.101709 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.102275 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.102291 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.126346 (+ 24055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.132421 (+ 6075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.132424 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.132426 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.132670 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.132962 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.132965 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.132967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.133037 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.133448 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.133451 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.133523 (+ 72us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.134085 (+ 562us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.134292 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12895,"thread_start_us":189,"threads_started":1}
I20260810 03:45:38.135469 30586 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5ceac01c98f24112b930a35ee1144d4d (127.22.134.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.137342 30530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:38.138891 30530 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 FOLLOWER]: Refusing update from remote peer 920d4b792c7a4e2eadd5ac2718b98534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 03:45:38.139539 30380 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:38.141842 30377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.135739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.0.0.1:34772)
0810 03:45:38.135850 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.135867 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.135951 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.137451 (+ 1500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.137454 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.137474 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:38.137572 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.137578 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.138698 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.138702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.140019 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.140032 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.141385 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.141389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.141490 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.141543 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.141623 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.141707 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 03:45:38.142400 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.136015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34772 (local address 127.22.134.253:44595)
0810 03:45:38.136999 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.137004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.137018 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:45:38.137067 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.137070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.137130 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.137237 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:38.137737 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.138555 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.140219 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.141048 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.141173 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.141316 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.142196 (+ 880us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.142282 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":898}
I20260810 03:45:38.142944 30438 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 LEARNER]: Refusing update from remote peer 920d4b792c7a4e2eadd5ac2718b98534: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 03:45:38.143509 30380 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 03:45:38.144550 30586 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.134.252:43203
I20260810 03:45:38.145030 30386 master.cc:537] Master@127.22.134.252:43203 shutting down...
I20260810 03:45:38.145444 30438 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5ceac01c98f24112b930a35ee1144d4d (127.22.134.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.145783 30586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.145953 30586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:38.147986 30470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 920d4b792c7a4e2eadd5ac2718b98534. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.148128 30470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: This master's current role is: LEARNER
I20260810 03:45:38.148226 30470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.148311 30470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: This master's current role is: LEARNER
I20260810 03:45:38.148432 30530 raft_consensus.cc:858] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } }
W20260810 03:45:38.148862 30530 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } }
I20260810 03:45:38.151105 30588 mvcc.cc:205] Tried to move back new op lower bound from 7316822166183636992 to 7316822166146199552. Current Snapshot: MvccSnapshot[applied={T|T < 7316822166183636992}]
I20260810 03:45:38.151507 30530 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } }
I20260810 03:45:38.152940 30380 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: attempting to promote NON_VOTER 4c104723ad384a28a4b4e73d08ee6309 to VOTER
I20260810 03:45:38.153419 30380 consensus_queue.cc:237] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } }
I20260810 03:45:38.155236 30438 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 LEARNER]: Refusing update from remote peer 920d4b792c7a4e2eadd5ac2718b98534: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260810 03:45:38.155675 29729 consensus_peers.cc:487] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 -> Peer 5ceac01c98f24112b930a35ee1144d4d (127.22.134.252:43203): Couldn't send request to peer 5ceac01c98f24112b930a35ee1144d4d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 03:45:38.155797 30381 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 03:45:38.157820 30381 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.157940 30563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 920d4b792c7a4e2eadd5ac2718b98534. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } }
I20260810 03:45:38.158049 30563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 03:45:38.158191 30563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } }
I20260810 03:45:38.158254 30563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 03:45:38.158317 30563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: NON_VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: true } } }
I20260810 03:45:38.158387 30563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 03:45:38.159467 30381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.159623 30381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:38.159425 30438 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.159755 30381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.159827 30381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:38.161290 30589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.161425 30589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:45:38.163951 30386 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260810 03:45:38.164234 30386 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260810 03:45:38.164319 30386 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: stopping tablet replica
I20260810 03:45:38.180485 30386 master.cc:552] Master@127.22.134.252:43203 shutdown complete.
I20260810 03:45:38.180558 30386 master_runner.cc:305] Clearing existing system tablet
I20260810 03:45:38.180851 30386 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:38.180914 30386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:38.182371 30386 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:38.183312 30597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.183583 30386 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:38.183719 30386 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:38.183763 30386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
uuid: "5ceac01c98f24112b930a35ee1144d4d"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e05251c6356020d0ff56e51d65a3f1ed"
server_key_iv: "5db17c4d072da9d12cd2f557ffe04e69"
server_key_version: "encryptionkey@0"
I20260810 03:45:38.186239 30386 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:38.188992 30386 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 03:45:38.189108 30386 log.cc:1196] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 03:45:38.189466 30386 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Deleting consensus metadata
I20260810 03:45:38.189669 30386 master_runner.cc:315] Copying system tablet from 127.22.134.254:43561
I20260810 03:45:38.191035 30386 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: tablet copy: Beginning tablet copy session from remote peer at address 127.22.134.254:43561
I20260810 03:45:38.201664 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.191808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41852 (local address 127.22.134.254:43561)
0810 03:45:38.191947 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.191952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.192168 (+ 216us) server_negotiation.cc:407] Connection header received
0810 03:45:38.192307 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.192311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.192373 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.192485 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.193170 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.194147 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.195764 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.196138 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.196237 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.197802 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.197806 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.197809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.197847 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.199617 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.200145 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.200149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.200152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.200249 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.200572 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.200576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.200578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.200883 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.201006 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.201336 (+ 330us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.201462 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:45:38.201666 30604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.191680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:41852)
0810 03:45:38.192049 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.192067 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.192200 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.192538 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.192542 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.192834 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.192994 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.193003 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.194465 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.194469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.195607 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.195619 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.196392 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.196396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.196497 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.197205 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.197226 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.197624 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.199756 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.199761 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.199763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.200027 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.200356 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.200359 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.200362 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.200464 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.200993 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.200997 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.201149 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.201275 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.201460 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":114,"threads_started":1}
I20260810 03:45:38.202206 29769 tablet_copy_service.cc:140] P 920d4b792c7a4e2eadd5ac2718b98534: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5ceac01c98f24112b930a35ee1144d4d ({username='oryx', principal='oryx/127.22.134.252@KRBTEST.COM'} at 127.0.0.1:41852)
I20260810 03:45:38.202317 29769 tablet_copy_service.cc:161] P 920d4b792c7a4e2eadd5ac2718b98534: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5ceac01c98f24112b930a35ee1144d4d at {username='oryx', principal='oryx/127.22.134.252@KRBTEST.COM'} at 127.0.0.1:41852: session id = 5ceac01c98f24112b930a35ee1144d4d-00000000000000000000000000000000
I20260810 03:45:38.203281 29769 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 03:45:38.204643 30386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 03:45:38.207051 30386 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: tablet copy: Starting download of 0 data blocks...
I20260810 03:45:38.207355 30386 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: tablet copy: Starting download of 1 WAL segments...
I20260810 03:45:38.209123 30386 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 03:45:38.210933 29769 tablet_copy_service.cc:342] P 920d4b792c7a4e2eadd5ac2718b98534: Request end of tablet copy session 5ceac01c98f24112b930a35ee1144d4d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.134.252@KRBTEST.COM'} at 127.0.0.1:41852
I20260810 03:45:38.211056 29769 tablet_copy_service.cc:433] P 920d4b792c7a4e2eadd5ac2718b98534: ending tablet copy session 5ceac01c98f24112b930a35ee1144d4d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5ceac01c98f24112b930a35ee1144d4d
I20260810 03:45:38.217629 30114 heartbeater.cc:503] Master 127.22.134.254:43561 was elected leader, sending a full tablet report...
I20260810 03:45:38.220148 30386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:38.222121 30605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:38.222299 30610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:38.222764 30606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:38.224913 30386 server_base.cc:1034] running on GCE node
I20260810 03:45:38.225145 30386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:38.225526 30386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:38.226706 30386 hybrid_clock.cc:648] HybridClock initialized: now 1786333538226714 us; error 51 us; skew 500 ppm
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:38.228446 30386 init.cc:377] Logged in from keytab as oryx/127.22.134.252@KRBTEST.COM (short username oryx)
I20260810 03:45:38.229074 30386 webserver.cc:460] Webserver started at http://127.22.134.252:42749/ using document root <none> and password file <none>
I20260810 03:45:38.229331 30386 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:38.229408 30386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:38.230698 30386 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:38.231910 30619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.232285 30386 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:38.232391 30386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
uuid: "5ceac01c98f24112b930a35ee1144d4d"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e05251c6356020d0ff56e51d65a3f1ed"
server_key_iv: "5db17c4d072da9d12cd2f557ffe04e69"
server_key_version: "encryptionkey@0"
I20260810 03:45:38.232518 30386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:38.242969 30386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:38.245477 30386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:38.251121 30386 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.252:43203
I20260810 03:45:38.251137 30678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.252:43203 every 8 connection(s)
I20260810 03:45:38.251775 30386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
I20260810 03:45:38.253597 30680 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:45:38.254577 30680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Bootstrap starting.
I20260810 03:45:38.263362 30680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:45:38.263725 30680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Bootstrap complete.
I20260810 03:45:38.264287 30680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } }
I20260810 03:45:38.264438 30680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5ceac01c98f24112b930a35ee1144d4d, State: Initialized, Role: LEARNER
I20260810 03:45:38.264573 30680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } }
I20260810 03:45:38.265038 30688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.265223 30688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: LEARNER
I20260810 03:45:38.265246 30680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:38.270026 30700 catalog_manager.cc:1259] Loaded cluster ID: d0b839249aaa4de3b8ef530ff86925d0
I20260810 03:45:38.270112 30700 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: loading cluster ID for follower catalog manager: success
W20260810 03:45:38.270077 30585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:38.270408 30585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:38.270470 30585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 03:45:38.271922 30700 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: acquiring CA information for follower catalog manager: success
I20260810 03:45:38.273334 30700 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 03:45:38.276566 30585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:38.276638 30585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:38.276755 30585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:38.285617 30585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab
--principal=oryx/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:42133
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=33521
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595,127.22.134.252:43203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:38.287065 30585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:38.288869 30585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:38.302250 30702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:38.302286 30705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:38.302277 30703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:38.302673 30585 server_base.cc:1034] running on GCE node
I20260810 03:45:38.303103 30585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:38.303812 30585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:38.304998 30585 hybrid_clock.cc:648] HybridClock initialized: now 1786333538304975 us; error 40 us; skew 500 ppm
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:38.308444 30585 init.cc:377] Logged in from keytab as oryx/127.22.134.193@KRBTEST.COM (short username oryx)
I20260810 03:45:38.309446 30585 webserver.cc:460] Webserver started at http://127.22.134.193:33521/ using document root <none> and password file <none>
I20260810 03:45:38.310050 30585 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:38.310154 30585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:38.314790 30585 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:45:38.317255 30712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.318590 30585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:38.318742 30585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "59ba3b64635d487cbe632425bf9ff110"
format_stamp: "Formatted at 2026-08-10 03:45:36 on dist-test-slave-qg60"
server_key: "bbd51bb9feb585aa3279dc1927f13126"
server_key_iv: "4fd6242652cb9a86aa65b47d515426c5"
server_key_version: "encryptionkey@0"
I20260810 03:45:38.319396 30585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:38.348194 30585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:38.351791 30585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:38.352026 30585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:38.352816 30585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:38.353775 30585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:38.353849 30585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.353924 30585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:38.353968 30585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.370184 30585 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:42133
I20260810 03:45:38.370251 30839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:42133 every 8 connection(s)
I20260810 03:45:38.371335 30585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:38.377883 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 30585
I20260810 03:45:38.378110 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 29965
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.252@KRBTEST.COM
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.253@KRBTEST.COM
I20260810 03:45:38.392351 30848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.375845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:36485 (local address 127.22.134.252:43203)
0810 03:45:38.376667 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.376710 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.376768 (+ 58us) server_negotiation.cc:407] Connection header received
0810 03:45:38.376855 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.376859 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.376912 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.377002 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.378986 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.379978 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.381750 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.382114 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.382213 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.386692 (+ 4479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.386700 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.386707 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.386751 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.390287 (+ 3536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.390762 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.390766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.390768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.390858 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.391158 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.391161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.391163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.391355 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.391462 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.392022 (+ 560us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.392169 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":141,"threads_started":1}
I20260810 03:45:38.392416 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.375555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:33201 (local address 127.22.134.253:44595)
0810 03:45:38.375716 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.375723 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.376409 (+ 686us) server_negotiation.cc:407] Connection header received
0810 03:45:38.376885 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.376888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.376939 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.376997 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.381547 (+ 4550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.382666 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.384143 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.384469 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.384555 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.387446 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.387453 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.387460 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.387509 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.389376 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.390356 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.390362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.390367 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.390463 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.390930 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.390937 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.390942 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.391214 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.391306 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.392029 (+ 723us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.392178 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:45:38.393990 30845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.375357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.22.134.193:33201)
0810 03:45:38.376276 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.376293 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.376613 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.377198 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.377205 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.377996 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.381335 (+ 3339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.381350 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.382840 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.382847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.384007 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.384021 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.384715 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.384720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.384889 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.385560 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.385577 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.387257 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.389516 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.389525 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.389813 (+ 288us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.390226 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.390591 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.390597 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.390602 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.390817 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.391381 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.391391 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.391772 (+ 381us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.392578 (+ 806us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.392784 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"mutex_wait_us":51,"spinlock_wait_cycles":39296,"thread_start_us":556,"threads_started":1}
I20260810 03:45:38.394004 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.375677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:43203 (local address 127.22.134.193:36485)
0810 03:45:38.376394 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.376408 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.376608 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.377199 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.377206 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.377983 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.378809 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.378830 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.380123 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.380128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.381608 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.381622 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.382393 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.382399 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.382626 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.383538 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.383565 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.386418 (+ 2853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.390422 (+ 4004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.390425 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.390427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.390646 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.390955 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.390959 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.390961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.391056 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.391456 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.391459 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.391766 (+ 307us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.391967 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.392345 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"mutex_wait_us":106,"spinlock_wait_cycles":11904,"thread_start_us":189,"threads_started":1}
I20260810 03:45:38.395411 30841 heartbeater.cc:347] Connected to a master server at 127.22.134.252:43203
I20260810 03:45:38.395416 30842 heartbeater.cc:347] Connected to a master server at 127.22.134.253:44595
I20260810 03:45:38.395673 30841 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.395671 30842 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.395846 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:40889
--local_ip_for_outbound_sockets=127.22.134.194
--tserver_master_addrs=127.22.134.254:43561
--webserver_port=40027
--webserver_interface=127.22.134.194
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab
--principal=oryx/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595,127.22.134.252:43203 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:45:38.396932 30841 heartbeater.cc:511] Master 127.22.134.252:43203 requested a full tablet report, sending...
I20260810 03:45:38.398056 30842 heartbeater.cc:511] Master 127.22.134.253:44595 requested a full tablet report, sending...
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:38.398976 30639 ts_manager.cc:194] Registered new tserver with Master: 59ba3b64635d487cbe632425bf9ff110 (127.22.134.193:42133)
I20260810 03:45:38.399118 30415 ts_manager.cc:194] Registered new tserver with Master: 59ba3b64635d487cbe632425bf9ff110 (127.22.134.193:42133)
I20260810 03:45:38.402907 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.373389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:55803 (local address 127.22.134.254:43561)
0810 03:45:38.373556 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.373559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.375082 (+ 1523us) server_negotiation.cc:407] Connection header received
0810 03:45:38.376899 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.376904 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.376966 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.377041 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.393202 (+ 16161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.394029 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.395305 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.395635 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.395728 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.399378 (+ 3650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.399382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.399384 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.399420 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.401024 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.401577 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.401580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.401581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.401659 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.401962 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.401969 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.401971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.402170 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.402284 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.402634 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.402756 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:45:38.402920 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.373790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:55803)
0810 03:45:38.374903 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.374948 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.376608 (+ 1660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.377199 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.377206 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.378086 (+ 880us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.393018 (+ 14932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.393027 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.394252 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.394255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.395093 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.395105 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.395974 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.395979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.396121 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.396662 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.396674 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.399160 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.401138 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.401144 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.401149 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.401459 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.401761 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.401764 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.401766 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.401859 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.402279 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.402282 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.402391 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.402559 (+ 168us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.402727 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"mutex_wait_us":18,"thread_start_us":692,"threads_started":1}
I20260810 03:45:38.404093 30840 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43561
I20260810 03:45:38.404220 30840 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.404410 30840 heartbeater.cc:511] Master 127.22.134.254:43561 requested a full tablet report, sending...
I20260810 03:45:38.405408 29743 ts_manager.cc:194] Re-registered known tserver with Master: 59ba3b64635d487cbe632425bf9ff110 (127.22.134.193:42133)
I20260810 03:45:38.406136 29743 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:55803
I20260810 03:45:38.442198 30265 heartbeater.cc:503] Master 127.22.134.254:43561 was elected leader, sending a full tablet report...
W20260810 03:45:38.516849 30849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:38.517182 30849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:38.517262 30849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:38.521346 30849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:38.521564 30849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:38.521750 30849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:38.528261 30849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab
--principal=oryx/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:40889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=40027
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595,127.22.134.252:43203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:38.529552 30849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:38.530591 30849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:38.541380 30857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:38.541373 30855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:38.541405 30849 server_base.cc:1034] running on GCE node
W20260810 03:45:38.541752 30854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:38.542198 30849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:38.542893 30849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:38.544061 30849 hybrid_clock.cc:648] HybridClock initialized: now 1786333538544046 us; error 30 us; skew 500 ppm
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:38.547207 30849 init.cc:377] Logged in from keytab as oryx/127.22.134.194@KRBTEST.COM (short username oryx)
I20260810 03:45:38.548141 30849 webserver.cc:460] Webserver started at http://127.22.134.194:40027/ using document root <none> and password file <none>
I20260810 03:45:38.548794 30849 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:38.548897 30849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:38.553447 30849 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:45:38.555683 30864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.557060 30849 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:38.557200 30849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "b8dc07c362654e9c9d7063e080866e89"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "e40059eb4382110afd6d295e4b3330a1"
server_key_iv: "0b09eb897373b937fe3542232e302160"
server_key_version: "encryptionkey@0"
I20260810 03:45:38.557865 30849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:38.583535 30849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:38.587154 30849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:38.587368 30849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:38.587980 30849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:38.588999 30849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:38.589048 30849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.589109 30849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:38.589140 30849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.599282 30849 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:40889
I20260810 03:45:38.599327 30996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:40889 every 8 connection(s)
I20260810 03:45:38.600346 30849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:38.606164 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 30849
I20260810 03:45:38.606406 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 30119
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.253@KRBTEST.COM
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.252@KRBTEST.COM
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:38.620378 30848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.602387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:56643 (local address 127.22.134.252:43203)
0810 03:45:38.602573 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.602578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.604017 (+ 1439us) server_negotiation.cc:407] Connection header received
0810 03:45:38.605542 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.605545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.605607 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.605678 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.608514 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.609332 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.610577 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.610928 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.611012 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.615016 (+ 4004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.615020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.615023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.615060 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.617458 (+ 2398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.618340 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.618343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.618345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.618434 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.618898 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.618902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.618903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.619137 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.619224 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.620064 (+ 840us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.620216 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260810 03:45:38.620378 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.602600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:42415 (local address 127.22.134.253:44595)
0810 03:45:38.602781 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.602785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.604260 (+ 1475us) server_negotiation.cc:407] Connection header received
0810 03:45:38.605464 (+ 1204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.605467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.605531 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.605589 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.607506 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.608317 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.610079 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.610451 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.610541 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.615359 (+ 4818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.615364 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.615369 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.615403 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.617564 (+ 2161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.618340 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.618343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.618345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.618434 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.618900 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.618902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.618904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.619145 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.619224 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.620065 (+ 841us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.620203 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:45:38.620661 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.603367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:49443 (local address 127.22.134.254:43561)
0810 03:45:38.603538 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.603551 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.604506 (+ 955us) server_negotiation.cc:407] Connection header received
0810 03:45:38.605468 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.605474 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.605559 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.605650 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.608699 (+ 3049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.609870 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.611588 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.611882 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.612018 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.615454 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.615462 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.615467 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.615519 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.617826 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.618695 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.618702 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.618707 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.618842 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.619265 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.619273 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.619277 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.619637 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.619740 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.620216 (+ 476us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.620389 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 03:45:38.622412 31003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.603388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:49443)
0810 03:45:38.604359 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.604371 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.605196 (+ 825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.605887 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.605897 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.608122 (+ 2225us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.608500 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.608516 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.610081 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.610087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.611441 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.611457 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.612093 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.612102 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.612300 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.613028 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.613052 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.615237 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.617980 (+ 2743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.617983 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.617985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.618376 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.618991 (+ 615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.618998 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.619003 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.619126 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.619835 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.619840 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.619962 (+ 122us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.620880 (+ 918us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.621366 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"mutex_wait_us":255,"spinlock_wait_cycles":11776,"thread_start_us":178,"threads_started":1}
I20260810 03:45:38.622409 31002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.603127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.22.134.194:42415)
0810 03:45:38.604159 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.604176 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.605196 (+ 1020us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.605887 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.605897 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.606650 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.607310 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.607330 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.608507 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.608510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.609937 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.609947 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.610762 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.610765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.610989 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.612031 (+ 1042us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.612054 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.615178 (+ 3124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.617673 (+ 2495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.617676 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.617677 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.618213 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.618547 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.618550 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.618553 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.618782 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.619300 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.619307 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.619743 (+ 436us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.620626 (+ 883us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.621150 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":950,"mutex_wait_us":129,"spinlock_wait_cycles":60544,"thread_start_us":188,"threads_started":1}
I20260810 03:45:38.623623 31001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.603126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:43203 (local address 127.22.134.194:56643)
0810 03:45:38.603829 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.603883 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.605214 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.605887 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.605899 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.608066 (+ 2167us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.608353 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.608366 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.609481 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.609483 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.610439 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.610449 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.611175 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.611179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.611303 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.612228 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.612242 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.614781 (+ 2539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.617612 (+ 2831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.617623 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.617647 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.618218 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.618547 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.618550 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.618553 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.618782 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.619300 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.619307 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.619743 (+ 436us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.620626 (+ 883us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.621215 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":250,"spinlock_wait_cycles":9856,"thread_start_us":206,"threads_started":1}
I20260810 03:45:38.624341 30999 heartbeater.cc:347] Connected to a master server at 127.22.134.253:44595
I20260810 03:45:38.624341 30997 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43561
I20260810 03:45:38.624615 30999 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.624621 30997 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.625303 30999 heartbeater.cc:511] Master 127.22.134.253:44595 requested a full tablet report, sending...
I20260810 03:45:38.625303 30997 heartbeater.cc:511] Master 127.22.134.254:43561 requested a full tablet report, sending...
I20260810 03:45:38.626482 29743 ts_manager.cc:194] Re-registered known tserver with Master: b8dc07c362654e9c9d7063e080866e89 (127.22.134.194:40889)
I20260810 03:45:38.626556 30415 ts_manager.cc:194] Registered new tserver with Master: b8dc07c362654e9c9d7063e080866e89 (127.22.134.194:40889)
I20260810 03:45:38.627257 29743 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:49443
I20260810 03:45:38.627601 30998 heartbeater.cc:347] Connected to a master server at 127.22.134.252:43203
I20260810 03:45:38.627701 30998 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.629002 30998 heartbeater.cc:511] Master 127.22.134.252:43203 requested a full tablet report, sending...
I20260810 03:45:38.629835 30639 ts_manager.cc:194] Registered new tserver with Master: b8dc07c362654e9c9d7063e080866e89 (127.22.134.194:40889)
I20260810 03:45:38.632911 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:37497
--local_ip_for_outbound_sockets=127.22.134.195
--tserver_master_addrs=127.22.134.254:43561
--webserver_port=45283
--webserver_interface=127.22.134.195
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab
--principal=oryx/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595,127.22.134.252:43203 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:45:38.651647 31005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.647700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:43203 (local address 127.0.0.1:60402)
0810 03:45:38.648039 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.648052 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.648189 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.648672 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.648717 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.648766 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:38.648882 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.648889 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.649689 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.649693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.650483 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.650492 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.651217 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.651220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.651311 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.651336 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.651398 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.651495 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":80,"threads_started":1}
I20260810 03:45:38.651644 30848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.647761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60402 (local address 127.22.134.252:43203)
0810 03:45:38.647919 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.647925 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.648136 (+ 211us) server_negotiation.cc:407] Connection header received
0810 03:45:38.648313 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.648315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.648374 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.648526 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:38.649025 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.649566 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.650616 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.651080 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.651216 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.651398 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.651434 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.651512 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 03:45:38.652339 30652 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 03:45:38.652670 30688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 920d4b792c7a4e2eadd5ac2718b98534. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.653101 30688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: LEARNER
W20260810 03:45:38.760856 31004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:38.761159 31004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:38.761241 31004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:38.765467 31004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:38.765533 31004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:38.765645 31004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:38.771384 31004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab
--principal=oryx/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:37497
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=45283
--tserver_master_addrs=127.22.134.254:43561,127.22.134.253:44595,127.22.134.252:43203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:38.772527 31004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:38.773608 31004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:38.783864 31014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:38.783854 31010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:38.783854 31012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:38.784281 31004 server_base.cc:1034] running on GCE node
I20260810 03:45:38.784878 31004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:38.785552 31004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:38.786743 31004 hybrid_clock.cc:648] HybridClock initialized: now 1786333538786732 us; error 33 us; skew 500 ppm
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:38.789716 31004 init.cc:377] Logged in from keytab as oryx/127.22.134.195@KRBTEST.COM (short username oryx)
I20260810 03:45:38.790663 31004 webserver.cc:460] Webserver started at http://127.22.134.195:45283/ using document root <none> and password file <none>
I20260810 03:45:38.791292 31004 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:38.791414 31004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:38.795938 31004 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:38.798223 31023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.799495 31004 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:38.799633 31004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "9c40d4d1baba47fb929dde9445e76f40"
format_stamp: "Formatted at 2026-08-10 03:45:37 on dist-test-slave-qg60"
server_key: "6812389695825d73b9a15c0f67224e56"
server_key_iv: "aa89f2a6f579a7f4bb28f004c05c07e8"
server_key_version: "encryptionkey@0"
I20260810 03:45:38.800206 31004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:38.816421 31004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:38.819903 31004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:38.820132 31004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:38.820815 31004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:38.821736 31004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:38.821810 31004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.821883 31004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:38.821933 31004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:38.831530 31004 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:37497
I20260810 03:45:38.831557 31154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:37497 every 8 connection(s)
I20260810 03:45:38.832594 31004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:38.832981 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 31004
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:38.849386 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.836747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34778 (local address 127.22.134.253:44595)
0810 03:45:38.837810 (+ 1063us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.837815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.837827 (+ 12us) server_negotiation.cc:407] Connection header received
0810 03:45:38.837869 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.837875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.837930 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.839720 (+ 1790us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.839837 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.840624 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.842308 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.842683 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.843180 (+ 497us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.844704 (+ 1524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.844710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.844715 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.844776 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.846778 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.847374 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.847378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.847380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.847489 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.847856 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.847859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.847861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.848106 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.848953 (+ 847us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.849048 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.849196 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":998,"thread_start_us":68,"threads_started":1}
I20260810 03:45:38.850579 31167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.835763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60418 (local address 127.22.134.252:43203)
0810 03:45:38.836590 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.836594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.837157 (+ 563us) server_negotiation.cc:407] Connection header received
0810 03:45:38.837273 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.837276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.837328 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.837430 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.838528 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.839327 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.840511 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.840874 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.840970 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.842800 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.842804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.842807 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.842834 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.847971 (+ 5137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.848861 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.848865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.848867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.848952 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.849249 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.849253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.849255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.849518 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.849652 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.850240 (+ 588us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.850372 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":757,"thread_start_us":92,"threads_started":1}
I20260810 03:45:38.850916 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.836611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.22.134.254:43561)
0810 03:45:38.837723 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.837737 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.837749 (+ 12us) server_negotiation.cc:407] Connection header received
0810 03:45:38.837793 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.837795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.837846 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.838125 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.839679 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.840552 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.842242 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.842579 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.843332 (+ 753us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.845661 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.845667 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.845673 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.845703 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.847984 (+ 2281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.848686 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.848690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.848691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.848814 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.849185 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.849188 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.849189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.849405 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.850363 (+ 958us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.850455 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.850738 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1036,"thread_start_us":81,"threads_started":1}
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.252@KRBTEST.COM
I20260810 03:45:38.853849 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.835690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:60813 (local address 127.22.134.254:43561)
0810 03:45:38.835854 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.835859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.837275 (+ 1416us) server_negotiation.cc:407] Connection header received
0810 03:45:38.838356 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.838361 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.838412 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.838610 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.840107 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.840867 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.842614 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.842925 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.843022 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.847184 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.847188 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.847190 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.847220 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.850057 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.851787 (+ 1730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.851792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.851795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.851906 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.852380 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.852385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.852387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.852635 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.852715 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.853498 (+ 783us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.853645 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
Aug 10 03:45:38 dist-test-slave-qg60 krb5kdc[29698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333538, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.253@KRBTEST.COM
I20260810 03:45:38.855684 31165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.835466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:60813)
0810 03:45:38.837192 (+ 1726us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.837207 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.838072 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.838744 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.838754 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.839220 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.839928 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.839948 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.841037 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.841041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.842458 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.842471 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.843225 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.843227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.843455 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.844974 (+ 1519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.844995 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.846994 (+ 1999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.850195 (+ 3201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.850203 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.850221 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.850573 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.852031 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.852037 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.852042 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.852259 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.852851 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.852860 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.853177 (+ 317us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.854083 (+ 906us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.854469 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1633,"mutex_wait_us":117,"spinlock_wait_cycles":29312,"thread_start_us":157,"threads_started":1}
I20260810 03:45:38.857197 30848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.835701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:41847 (local address 127.22.134.252:43203)
0810 03:45:38.835967 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.835972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.837615 (+ 1643us) server_negotiation.cc:407] Connection header received
0810 03:45:38.838866 (+ 1251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.838870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.838932 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.838990 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.843984 (+ 4994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.844795 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.846106 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.846452 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.846536 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.853351 (+ 6815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.853355 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.853357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.853382 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.855363 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.855918 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.855922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.855924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.856016 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.856300 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.856303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.856305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.856508 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.856588 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.856934 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.857062 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260810 03:45:38.858047 31166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.835466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:43203 (local address 127.22.134.195:41847)
0810 03:45:38.837530 (+ 2064us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.837546 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.838717 (+ 1171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.839247 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.839251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.839583 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.843875 (+ 4292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.843883 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.845118 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.845122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.845953 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.845963 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.846690 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.846693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.846824 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.850906 (+ 4082us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.850916 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.853191 (+ 2275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.855497 (+ 2306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.855500 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.855502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.855794 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.856123 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.856126 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.856127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.856207 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.856644 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.856647 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.856758 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.857325 (+ 567us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.857763 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1952,"mutex_wait_us":4598,"spinlock_wait_cycles":896,"thread_start_us":99,"threads_started":1}
I20260810 03:45:38.858501 31155 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43561
I20260810 03:45:38.858592 31156 heartbeater.cc:347] Connected to a master server at 127.22.134.252:43203
I20260810 03:45:38.858788 31156 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.858790 31155 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.859433 31155 heartbeater.cc:511] Master 127.22.134.254:43561 requested a full tablet report, sending...
I20260810 03:45:38.859433 31156 heartbeater.cc:511] Master 127.22.134.252:43203 requested a full tablet report, sending...
I20260810 03:45:38.860193 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.836651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:33673 (local address 127.22.134.253:44595)
0810 03:45:38.836816 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.836821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.837052 (+ 231us) server_negotiation.cc:407] Connection header received
0810 03:45:38.844065 (+ 7013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.844068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.844118 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.844169 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:38.848492 (+ 4323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.849292 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.852850 (+ 3558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.853223 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.853345 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.856224 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:38.856228 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:38.856230 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:38.856270 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:38.858294 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.858897 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.858902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.858905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.859010 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:38.859325 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:38.859328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:38.859329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:38.859546 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:38.859643 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.859941 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.860056 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:45:38.860211 31168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.835466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.22.134.195:33673)
0810 03:45:38.836893 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.836946 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.838400 (+ 1454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.844297 (+ 5897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.844300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.844481 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:38.844688 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.844695 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.851823 (+ 7128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.851826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.852687 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.852700 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.853420 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.853426 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.853553 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.854237 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:38.854250 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:38.856060 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:38.858456 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.858459 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.858461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.858766 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.859119 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:38.859121 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:38.859123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:38.859213 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:38.859694 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:38.859696 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:38.859769 (+ 73us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.859874 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.860014 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1169,"thread_start_us":164,"threads_started":1}
I20260810 03:45:38.860580 29746 ts_manager.cc:194] Re-registered known tserver with Master: 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497)
I20260810 03:45:38.860646 30639 ts_manager.cc:194] Registered new tserver with Master: 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497)
I20260810 03:45:38.854969 29743 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 03:45:38.861265 31157 heartbeater.cc:347] Connected to a master server at 127.22.134.253:44595
I20260810 03:45:38.861357 31157 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:38.861366 29746 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:60813
I20260810 03:45:38.861581 31157 heartbeater.cc:511] Master 127.22.134.253:44595 requested a full tablet report, sending...
I20260810 03:45:38.862275 30415 ts_manager.cc:194] Registered new tserver with Master: 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497)
W20260810 03:45:38.862457 29743 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:38.865177 30380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: NON_VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: true } } }
I20260810 03:45:38.865338 30380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:38.867552 31175 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: attempting to promote NON_VOTER 5ceac01c98f24112b930a35ee1144d4d to VOTER
I20260810 03:45:38.867928 31175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } }
I20260810 03:45:38.869134 30438 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Refusing update from remote peer 920d4b792c7a4e2eadd5ac2718b98534: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 03:45:38.869235 30652 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 LEARNER]: Refusing update from remote peer 920d4b792c7a4e2eadd5ac2718b98534: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 03:45:38.869550 31174 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 03:45:38.869680 30380 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 03:45:38.871539 31175 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5ceac01c98f24112b930a35ee1144d4d (127.22.134.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:38.871842 30652 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5ceac01c98f24112b930a35ee1144d4d (127.22.134.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:38.873158 31175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:38.873256 31175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:38.873334 31174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:38.873477 31174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:38.873728 30438 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5ceac01c98f24112b930a35ee1144d4d (127.22.134.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:38.873346 31175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:38.875890 31175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534 [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:38.877517 30688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:38.877638 30688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:45:38.879356 31184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "920d4b792c7a4e2eadd5ac2718b98534" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:38.879498 31184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:45:38.888778 31005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.882241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40889 (local address 127.0.0.1:36168)
0810 03:45:38.882404 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.882421 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.882548 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.883972 (+ 1424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.883975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.883995 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:38.884107 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.884114 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.885800 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.885804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.887103 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.887114 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.888260 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.888264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.888353 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.888404 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.888493 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.888585 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":49}
I20260810 03:45:38.888849 31186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.882468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36168 (local address 127.22.134.194:40889)
0810 03:45:38.883389 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.883404 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.883448 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:45:38.883552 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.883558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.883824 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.883996 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:38.884265 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.885676 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.887250 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.888128 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.888255 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.888392 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.888536 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.888659 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":121,"threads_started":1}
I20260810 03:45:38.888984 31188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.882862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42133 (local address 127.0.0.1:38608)
0810 03:45:38.884236 (+ 1374us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.884251 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.884479 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.885139 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.885142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.885160 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:38.885267 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.885273 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.886586 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.886590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.887535 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.887545 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.888563 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.888566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.888640 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.888662 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.888708 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.888840 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1302,"mutex_wait_us":26,"thread_start_us":114,"threads_started":1}
I20260810 03:45:38.889140 31187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.882525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:37497 (local address 127.0.0.1:38294)
0810 03:45:38.882886 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:38.882903 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:38.882996 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:38.884567 (+ 1571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:38.884571 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:38.884594 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:38.884701 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.884709 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.886208 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.886213 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.887522 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:38.887532 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.888688 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.888692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:38.888810 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.888835 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:45:38.888892 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 03:45:38.888987 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":53,"thread_start_us":236,"threads_started":1}
I20260810 03:45:38.889693 31189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.883033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38608 (local address 127.22.134.193:42133)
0810 03:45:38.884765 (+ 1732us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.884784 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.884808 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:45:38.884880 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.884884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.885007 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.885159 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:38.885357 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.886431 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.887673 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.888435 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.889343 (+ 908us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.889436 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.889475 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.889541 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1577,"thread_start_us":69,"threads_started":1}
I20260810 03:45:38.890470 31190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:38.883154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38294 (local address 127.22.134.195:37497)
0810 03:45:38.883770 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:38.883812 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:38.883832 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:45:38.883894 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:38.883898 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:38.884234 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:38.884877 (+ 643us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:38.885014 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.886100 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.887654 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:38.888551 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:38.890044 (+ 1493us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:38.890167 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:38.890215 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 03:45:38.890304 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":339,"threads_started":1}
I20260810 03:45:38.892357 30919 tablet_service.cc:1467] Processing CreateTablet for tablet 04036d537e4144549947a3cffde24991 (DEFAULT_TABLE table=test-table [id=b56f07d3d9dd4a61969b6d23ae52d857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:38.892349 30765 tablet_service.cc:1467] Processing CreateTablet for tablet 04036d537e4144549947a3cffde24991 (DEFAULT_TABLE table=test-table [id=b56f07d3d9dd4a61969b6d23ae52d857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:38.893508 30765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04036d537e4144549947a3cffde24991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:38.893512 30919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04036d537e4144549947a3cffde24991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:38.895706 31081 tablet_service.cc:1467] Processing CreateTablet for tablet 04036d537e4144549947a3cffde24991 (DEFAULT_TABLE table=test-table [id=b56f07d3d9dd4a61969b6d23ae52d857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:38.896911 31081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04036d537e4144549947a3cffde24991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:38.901261 31191 tablet_bootstrap.cc:492] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Bootstrap starting.
I20260810 03:45:38.904173 31191 tablet_bootstrap.cc:654] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:38.905071 31191 log.cc:824] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:38.905902 31194 tablet_bootstrap.cc:492] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Bootstrap starting.
I20260810 03:45:38.907037 31191 tablet_bootstrap.cc:492] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: No bootstrap required, opened a new log
I20260810 03:45:38.907245 31191 ts_tablet_manager.cc:1397] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:45:38.908501 31194 tablet_bootstrap.cc:654] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:38.909822 31194 log.cc:824] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:38.911574 31191 raft_consensus.cc:348] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:38.911870 31191 raft_consensus.cc:374] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:38.911967 31191 raft_consensus.cc:729] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59ba3b64635d487cbe632425bf9ff110, State: Initialized, Role: FOLLOWER
I20260810 03:45:38.912199 31194 tablet_bootstrap.cc:492] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: No bootstrap required, opened a new log
I20260810 03:45:38.912410 31194 ts_tablet_manager.cc:1397] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260810 03:45:38.912446 31191 consensus_queue.cc:260] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:38.913151 30840 heartbeater.cc:503] Master 127.22.134.254:43561 was elected leader, sending a full tablet report...
I20260810 03:45:38.913486 31191 ts_tablet_manager.cc:1428] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Time spent starting tablet: real 0.006s user 0.000s sys 0.007s
I20260810 03:45:38.913569 31192 tablet_bootstrap.cc:492] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Bootstrap starting.
I20260810 03:45:38.916422 31192 tablet_bootstrap.cc:654] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:38.917546 31192 log.cc:824] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:38.917496 31194 raft_consensus.cc:348] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:38.917793 31194 raft_consensus.cc:374] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:38.917855 31194 raft_consensus.cc:729] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c40d4d1baba47fb929dde9445e76f40, State: Initialized, Role: FOLLOWER
I20260810 03:45:38.918403 31194 consensus_queue.cc:260] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:38.919348 31155 heartbeater.cc:503] Master 127.22.134.254:43561 was elected leader, sending a full tablet report...
I20260810 03:45:38.920452 31194 ts_tablet_manager.cc:1428] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260810 03:45:38.922827 31192 tablet_bootstrap.cc:492] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: No bootstrap required, opened a new log
I20260810 03:45:38.923069 31192 ts_tablet_manager.cc:1397] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.004s
I20260810 03:45:38.928188 31192 raft_consensus.cc:348] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:38.928493 31192 raft_consensus.cc:374] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:38.928560 31192 raft_consensus.cc:729] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8dc07c362654e9c9d7063e080866e89, State: Initialized, Role: FOLLOWER
I20260810 03:45:38.929128 31192 consensus_queue.cc:260] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:38.930085 30997 heartbeater.cc:503] Master 127.22.134.254:43561 was elected leader, sending a full tablet report...
I20260810 03:45:38.930392 31192 ts_tablet_manager.cc:1428] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
W20260810 03:45:39.084360 31158 tablet.cc:2369] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:45:39.102933 31000 tablet.cc:2369] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:39.118891 31196 raft_consensus.cc:482] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:39.119149 31196 raft_consensus.cc:504] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:39.120503 31196 leader_election.cc:288] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8dc07c362654e9c9d7063e080866e89 (127.22.134.194:40889), 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497)
W20260810 03:45:39.123944 30843 tablet.cc:2369] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:39.125437 31190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.121002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:55149 (local address 127.22.134.195:37497)
0810 03:45:39.121149 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:39.121156 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:39.121507 (+ 351us) server_negotiation.cc:407] Connection header received
0810 03:45:39.121623 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:39.121626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:39.121684 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:39.121769 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:39.122162 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.122770 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.124147 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.124779 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.124892 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.124948 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:39.125230 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 03:45:39.125305 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:45:39.125526 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.120857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:37497 (local address 127.22.134.193:55149)
0810 03:45:39.121381 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:39.121394 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:39.121525 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:39.121790 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:39.121793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:39.121809 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:39.122019 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:39.122029 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.122953 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.122956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:39.123977 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:39.123987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.124937 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.124941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:39.125050 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.125081 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:45:39.125196 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 03:45:39.125306 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":296,"threads_started":1}
I20260810 03:45:39.125667 31186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.121100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:51571 (local address 127.22.134.194:40889)
0810 03:45:39.121224 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:39.121243 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:39.121642 (+ 399us) server_negotiation.cc:407] Connection header received
0810 03:45:39.121763 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:39.121769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:39.121818 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:39.121898 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:39.122250 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.122757 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.124418 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.125040 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.125133 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.125192 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:39.125466 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 03:45:39.125542 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:45:39.125932 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.120857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40889 (local address 127.22.134.193:51571)
0810 03:45:39.121508 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:39.121526 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:39.121642 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:39.121932 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:39.121934 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:39.121950 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:39.122122 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:39.122132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.122880 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.122884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:39.124265 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:39.124276 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.125166 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.125172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:39.125327 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.125352 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:45:39.125434 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 03:45:39.125500 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":32,"thread_start_us":289,"threads_started":1}
I20260810 03:45:39.126287 31102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04036d537e4144549947a3cffde24991" candidate_uuid: "59ba3b64635d487cbe632425bf9ff110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c40d4d1baba47fb929dde9445e76f40" is_pre_election: true
I20260810 03:45:39.126590 30943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04036d537e4144549947a3cffde24991" candidate_uuid: "59ba3b64635d487cbe632425bf9ff110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8dc07c362654e9c9d7063e080866e89" is_pre_election: true
I20260810 03:45:39.126648 31102 raft_consensus.cc:2454] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59ba3b64635d487cbe632425bf9ff110 in term 0.
I20260810 03:45:39.126895 30943 raft_consensus.cc:2454] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59ba3b64635d487cbe632425bf9ff110 in term 0.
I20260810 03:45:39.127285 30714 leader_election.cc:302] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59ba3b64635d487cbe632425bf9ff110, 9c40d4d1baba47fb929dde9445e76f40; no voters:
I20260810 03:45:39.127609 31196 raft_consensus.cc:2781] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:39.127701 31196 raft_consensus.cc:482] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:39.127756 31196 raft_consensus.cc:3037] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:39.129174 31196 raft_consensus.cc:504] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:39.129528 31196 leader_election.cc:288] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [CANDIDATE]: Term 1 election: Requested vote from peers b8dc07c362654e9c9d7063e080866e89 (127.22.134.194:40889), 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497)
I20260810 03:45:39.129858 30943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04036d537e4144549947a3cffde24991" candidate_uuid: "59ba3b64635d487cbe632425bf9ff110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8dc07c362654e9c9d7063e080866e89"
I20260810 03:45:39.129884 31102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04036d537e4144549947a3cffde24991" candidate_uuid: "59ba3b64635d487cbe632425bf9ff110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c40d4d1baba47fb929dde9445e76f40"
I20260810 03:45:39.129992 30943 raft_consensus.cc:3037] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:39.130019 31102 raft_consensus.cc:3037] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:39.131189 31102 raft_consensus.cc:2454] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59ba3b64635d487cbe632425bf9ff110 in term 1.
I20260810 03:45:39.131211 30943 raft_consensus.cc:2454] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59ba3b64635d487cbe632425bf9ff110 in term 1.
I20260810 03:45:39.131517 30714 leader_election.cc:302] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 59ba3b64635d487cbe632425bf9ff110, 9c40d4d1baba47fb929dde9445e76f40, b8dc07c362654e9c9d7063e080866e89; no voters:
I20260810 03:45:39.131744 31196 raft_consensus.cc:2781] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:39.131968 31196 raft_consensus.cc:686] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 1 LEADER]: Becoming Leader. State: Replica: 59ba3b64635d487cbe632425bf9ff110, State: Running, Role: LEADER
I20260810 03:45:39.132355 31196 consensus_queue.cc:237] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } }
I20260810 03:45:39.136301 29743 catalog_manager.cc:5495] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59ba3b64635d487cbe632425bf9ff110 (127.22.134.193). New cstate: current_term: 1 leader_uuid: "59ba3b64635d487cbe632425bf9ff110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } health_report { overall_health: HEALTHY } } }
I20260810 03:45:39.185478 31189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.181284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38624 (local address 127.22.134.193:42133)
0810 03:45:39.181413 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:39.181417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:39.181430 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:39.181524 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:39.181527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:39.181583 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:39.181678 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:39.181892 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.182414 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.183455 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.183754 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.183844 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.184277 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:39.185019 (+ 742us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:39.185159 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:39.185266 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 03:45:39.185323 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:45:39.191794 30943 raft_consensus.cc:1261] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 1 FOLLOWER]: Refusing update from remote peer 59ba3b64635d487cbe632425bf9ff110: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:39.191818 31102 raft_consensus.cc:1261] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 1 FOLLOWER]: Refusing update from remote peer 59ba3b64635d487cbe632425bf9ff110: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:39.192742 31202 consensus_queue.cc:1035] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:39.192963 31196 consensus_queue.cc:1035] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:39.203688 31208 mvcc.cc:205] Tried to move back new op lower bound from 7316822176521637888 to 7316822176289300480. Current Snapshot: MvccSnapshot[applied={T|T < 7316822176521637888}]
I20260810 03:45:39.204838 31207 mvcc.cc:205] Tried to move back new op lower bound from 7316822176521637888 to 7316822176289300480. Current Snapshot: MvccSnapshot[applied={T|T < 7316822176521637888}]
I20260810 03:45:39.213781 29746 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:39.213934 29746 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:39.218262 29746 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 920d4b792c7a4e2eadd5ac2718b98534: Sending DeleteTablet for 3 replicas of tablet 04036d537e4144549947a3cffde24991
I20260810 03:45:39.219291 30765 tablet_service.cc:1514] Processing DeleteTablet for tablet 04036d537e4144549947a3cffde24991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:39 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:38608
I20260810 03:45:39.219444 31081 tablet_service.cc:1514] Processing DeleteTablet for tablet 04036d537e4144549947a3cffde24991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:39 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:38294
I20260810 03:45:39.219475 30919 tablet_service.cc:1514] Processing DeleteTablet for tablet 04036d537e4144549947a3cffde24991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:39 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:36168
I20260810 03:45:39.220384 31217 tablet_replica.cc:330] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: stopping tablet replica
I20260810 03:45:39.220778 31217 raft_consensus.cc:2229] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:39.221230 31217 raft_consensus.cc:2258] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:39.222420 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 29711
I20260810 03:45:39.223984 31217 ts_tablet_manager.cc:1905] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:39.227948 31217 ts_tablet_manager.cc:1918] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:39.228084 31217 log.cc:1196] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/04036d537e4144549947a3cffde24991
I20260810 03:45:39.228441 31217 ts_tablet_manager.cc:1939] T 04036d537e4144549947a3cffde24991 P 59ba3b64635d487cbe632425bf9ff110: Deleting consensus metadata
I20260810 03:45:39.229010 31218 tablet_replica.cc:330] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: stopping tablet replica
I20260810 03:45:39.229417 31218 raft_consensus.cc:2229] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:39.229831 31218 raft_consensus.cc:2258] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:39.230266 31219 tablet_replica.cc:330] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: stopping tablet replica
I20260810 03:45:39.230605 31219 raft_consensus.cc:2229] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:39.230919 31219 raft_consensus.cc:2258] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:39.231828 31218 ts_tablet_manager.cc:1905] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:39.232355 31219 ts_tablet_manager.cc:1905] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 03:45:39.234529 30716 connection.cc:535] server connection from 127.0.0.1:38608 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 03:45:39.235584 31219 ts_tablet_manager.cc:1918] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:39.235688 31219 log.cc:1196] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/04036d537e4144549947a3cffde24991
I20260810 03:45:39.238413 31219 ts_tablet_manager.cc:1939] T 04036d537e4144549947a3cffde24991 P b8dc07c362654e9c9d7063e080866e89: Deleting consensus metadata
W20260810 03:45:39.239768 30869 connection.cc:441] server connection from 127.0.0.1:36168 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36168 (request call id 1) could send its response
I20260810 03:45:39.241353 31218 ts_tablet_manager.cc:1918] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:39.241582 31218 log.cc:1196] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/04036d537e4144549947a3cffde24991
I20260810 03:45:39.241847 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.221439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34780 (local address 127.22.134.253:44595)
0810 03:45:39.221561 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:39.221566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:39.221899 (+ 333us) server_negotiation.cc:407] Connection header received
0810 03:45:39.222098 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:39.222101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:39.222158 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:39.222214 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:39.226503 (+ 4289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.227058 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.227954 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.228338 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.228454 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.237638 (+ 9184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:39.237643 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:39.237646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:39.237694 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:39.239665 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:39.240289 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:39.240293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:39.240295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:39.240384 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:39.240715 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:39.240718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:39.240720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:39.240977 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:39.241099 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:39.241514 (+ 415us) server_negotiation.cc:299] Negotiation successful
0810 03:45:39.241646 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 03:45:39.242319 31218 ts_tablet_manager.cc:1939] T 04036d537e4144549947a3cffde24991 P 9c40d4d1baba47fb929dde9445e76f40: Deleting consensus metadata
W20260810 03:45:39.243626 31026 connection.cc:441] server connection from 127.0.0.1:38294 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38294 (request call id 1) could send its response
I20260810 03:45:39.249261 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.238759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34794 (local address 127.22.134.253:44595)
0810 03:45:39.238877 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:39.238882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:39.239438 (+ 556us) server_negotiation.cc:407] Connection header received
0810 03:45:39.239683 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:39.239686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:39.239736 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:39.239786 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:39.240762 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.241581 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.242769 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.243130 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.243212 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.245245 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:39.245249 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:39.245252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:39.245278 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:39.247058 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:39.247547 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:39.247550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:39.247552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:39.247645 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:39.248166 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:39.248170 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:39.248171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:39.248389 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:39.248490 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:39.248935 (+ 445us) server_negotiation.cc:299] Negotiation successful
0810 03:45:39.249089 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:45:39.254815 31167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.245150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60436 (local address 127.22.134.252:43203)
0810 03:45:39.245296 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:39.245300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:39.245448 (+ 148us) server_negotiation.cc:407] Connection header received
0810 03:45:39.245618 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:39.245620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:39.245668 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:39.245716 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:39.246535 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.247254 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.248560 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.249023 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.249110 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.251326 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:39.251330 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:39.251333 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:39.251359 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:39.253090 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:39.253566 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:39.253570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:39.253572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:39.253662 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:39.253947 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:39.253950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:39.253952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:39.254169 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:39.254297 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:39.254525 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 03:45:39.254661 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:45:39.258792 30848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:39.221998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60432 (local address 127.22.134.252:43203)
0810 03:45:39.222108 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:39.222112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:39.243382 (+ 21270us) server_negotiation.cc:407] Connection header received
0810 03:45:39.243571 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:39.243576 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:39.243641 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:39.243720 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:39.244655 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.245466 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.246602 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:39.246958 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:39.247031 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:39.248579 (+ 1548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:39.248582 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:39.248585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:39.248610 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:39.251073 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:39.257431 (+ 6358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:39.257434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:39.257437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:39.257522 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:39.257849 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:39.257852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:39.257854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:39.258058 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:39.258163 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:39.258509 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 03:45:39.258641 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:45:40.205614 31228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.204960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:56397)
0810 03:45:40.205359 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.205467 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":113,"threads_started":1}
I20260810 03:45:40.206096 31229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.205575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:48677)
0810 03:45:40.205870 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.205972 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":68,"threads_started":1}
W20260810 03:45:40.206117 30840 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:43561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
W20260810 03:45:40.206672 31155 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:43561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:40.206995 31230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.206344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:60805)
0810 03:45:40.206705 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.206890 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":63,"threads_started":1}
W20260810 03:45:40.207403 30997 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:43561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:40.719043 31231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 920d4b792c7a4e2eadd5ac2718b98534)
I20260810 03:45:40.719174 31233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 920d4b792c7a4e2eadd5ac2718b98534)
I20260810 03:45:40.719302 31233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } }
I20260810 03:45:40.719331 31231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } }
I20260810 03:45:40.719854 31233 leader_election.cc:288] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561), 5ceac01c98f24112b930a35ee1144d4d (127.22.134.252:43203)
I20260810 03:45:40.720479 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.719942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42348)
0810 03:45:40.720283 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.720375 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":95,"threads_started":1}
W20260810 03:45:40.720659 30410 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:40.720976 31237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.720561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42360)
0810 03:45:40.720804 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.720868 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":71,"threads_started":1}
W20260810 03:45:40.721294 30624 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:40.721632 31231 leader_election.cc:288] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561), 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253:44595)
I20260810 03:45:40.721820 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.721587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42364)
0810 03:45:40.721711 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.721760 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260810 03:45:40.721972 30410 leader_election.cc:334] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561): Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:40.722323 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.722061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42376)
0810 03:45:40.722210 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.722262 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260810 03:45:40.722409 30624 leader_election.cc:334] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561): Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:40.724978 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.720077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:43203 (local address 127.0.0.1:60440)
0810 03:45:40.720384 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.720400 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:40.720501 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:40.720951 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:40.720956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:40.720976 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:40.721213 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:40.721223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:40.722594 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:40.722598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:40.723623 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:40.723633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:40.724472 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:40.724476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:40.724624 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:40.724652 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 03:45:40.724763 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 03:45:40.724834 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":1,"thread_start_us":60,"threads_started":1}
I20260810 03:45:40.724984 31236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.720271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60440 (local address 127.22.134.252:43203)
0810 03:45:40.720504 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:40.720509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:40.720581 (+ 72us) server_negotiation.cc:407] Connection header received
0810 03:45:40.720679 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:40.720682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:40.720807 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:40.721337 (+ 530us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:40.721499 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:40.722478 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:40.723742 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:40.724361 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:40.724461 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:40.724501 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:40.724801 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 03:45:40.724870 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":77,"threads_started":1}
I20260810 03:45:40.725435 31237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.721038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:44595 (local address 127.0.0.1:34796)
0810 03:45:40.721176 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.721192 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:40.721276 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:40.721802 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:40.721805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:40.721824 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:40.721931 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:40.721942 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:40.723013 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:40.723015 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:40.723978 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:40.723987 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:40.724994 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:40.725001 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:40.725156 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:40.725177 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 03:45:40.725250 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 03:45:40.725312 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"thread_start_us":72,"threads_started":1}
I20260810 03:45:40.725469 31240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.721123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34796 (local address 127.22.134.253:44595)
0810 03:45:40.721560 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:40.721569 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:40.721582 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:40.721625 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:40.721628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:40.721671 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:40.722054 (+ 383us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:40.722166 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:40.722906 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:40.724145 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:40.724884 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:40.724994 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:40.725054 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:40.725286 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 03:45:40.725361 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":358,"thread_start_us":111,"threads_started":1}
I20260810 03:45:40.725637 30650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4c104723ad384a28a4b4e73d08ee6309" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5ceac01c98f24112b930a35ee1144d4d" is_pre_election: true
I20260810 03:45:40.725849 30650 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c104723ad384a28a4b4e73d08ee6309 in term 1.
I20260810 03:45:40.725845 30437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ceac01c98f24112b930a35ee1144d4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4c104723ad384a28a4b4e73d08ee6309" is_pre_election: true
I20260810 03:45:40.726003 30437 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ceac01c98f24112b930a35ee1144d4d in term 1.
I20260810 03:45:40.726243 30408 leader_election.cc:302] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c104723ad384a28a4b4e73d08ee6309, 5ceac01c98f24112b930a35ee1144d4d; no voters: 920d4b792c7a4e2eadd5ac2718b98534
I20260810 03:45:40.726357 30620 leader_election.cc:302] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c104723ad384a28a4b4e73d08ee6309, 5ceac01c98f24112b930a35ee1144d4d; no voters: 920d4b792c7a4e2eadd5ac2718b98534
I20260810 03:45:40.726428 31233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 03:45:40.726486 31233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 920d4b792c7a4e2eadd5ac2718b98534)
I20260810 03:45:40.726539 31233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:45:40.726614 31231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 03:45:40.726717 31231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 920d4b792c7a4e2eadd5ac2718b98534)
I20260810 03:45:40.726776 31231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:45:40.727663 31233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } }
I20260810 03:45:40.727799 31231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } }
I20260810 03:45:40.728049 31233 leader_election.cc:288] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [CANDIDATE]: Term 2 election: Requested vote from peers 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561), 5ceac01c98f24112b930a35ee1144d4d (127.22.134.252:43203)
I20260810 03:45:40.728420 30650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4c104723ad384a28a4b4e73d08ee6309" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5ceac01c98f24112b930a35ee1144d4d"
I20260810 03:45:40.728499 31231 leader_election.cc:288] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 2 election: Requested vote from peers 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561), 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253:44595)
I20260810 03:45:40.728487 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.728176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42386)
0810 03:45:40.728369 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.728423 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260810 03:45:40.728609 30650 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c104723ad384a28a4b4e73d08ee6309 in current term 2: Already voted for candidate 5ceac01c98f24112b930a35ee1144d4d in this term.
I20260810 03:45:40.728852 30437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ceac01c98f24112b930a35ee1144d4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4c104723ad384a28a4b4e73d08ee6309"
I20260810 03:45:40.729010 30437 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ceac01c98f24112b930a35ee1144d4d in current term 2: Already voted for candidate 4c104723ad384a28a4b4e73d08ee6309 in this term.
I20260810 03:45:40.729194 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.729009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42400)
0810 03:45:40.729091 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.729138 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260810 03:45:40.729446 30410 leader_election.cc:334] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561): Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:40.729504 30410 leader_election.cc:302] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c104723ad384a28a4b4e73d08ee6309; no voters: 5ceac01c98f24112b930a35ee1144d4d, 920d4b792c7a4e2eadd5ac2718b98534
I20260810 03:45:40.729650 31237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.728332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42388)
0810 03:45:40.729514 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.729564 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1124}
I20260810 03:45:40.729640 31233 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 03:45:40.730225 31237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:40.730022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42402)
0810 03:45:40.730131 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:40.730176 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:45:40.730348 30624 leader_election.cc:334] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561): Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:40.730407 30624 leader_election.cc:302] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ceac01c98f24112b930a35ee1144d4d; no voters: 4c104723ad384a28a4b4e73d08ee6309, 920d4b792c7a4e2eadd5ac2718b98534
I20260810 03:45:40.730535 31231 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 03:45:41.207682 31242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:41.206876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:43467)
0810 03:45:41.207480 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:41.207561 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":114,"threads_started":1}
I20260810 03:45:41.208413 31243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:41.207222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:43299)
0810 03:45:41.207717 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:41.208335 (+ 618us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":70,"threads_started":1}
I20260810 03:45:41.208884 31244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:41.207909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:37459)
0810 03:45:41.208696 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:41.208786 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":95,"threads_started":1}
I20260810 03:45:42.209781 31245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.209194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:48277)
0810 03:45:42.209555 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.209643 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":105,"threads_started":1}
I20260810 03:45:42.210614 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.209343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:53941)
0810 03:45:42.210400 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.210468 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":971,"thread_start_us":78,"threads_started":1}
I20260810 03:45:42.210825 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.210004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:45423)
0810 03:45:42.210641 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.210709 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":72,"threads_started":1}
I20260810 03:45:42.577136 31248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:42.577289 31248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } }
I20260810 03:45:42.577771 31248 leader_election.cc:288] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561), 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253:44595)
I20260810 03:45:42.578279 30437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ceac01c98f24112b930a35ee1144d4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4c104723ad384a28a4b4e73d08ee6309" is_pre_election: true
I20260810 03:45:42.578423 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.578013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42630)
0810 03:45:42.578243 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.578303 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":79,"threads_started":1}
I20260810 03:45:42.578444 30437 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ceac01c98f24112b930a35ee1144d4d in term 2.
I20260810 03:45:42.578819 30620 leader_election.cc:302] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c104723ad384a28a4b4e73d08ee6309, 5ceac01c98f24112b930a35ee1144d4d; no voters:
I20260810 03:45:42.579000 31248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 03:45:42.579072 31248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:42.579129 31248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 2 FOLLOWER]: Advancing to term 3
I20260810 03:45:42.579365 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.579073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42636)
0810 03:45:42.579249 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.579309 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260810 03:45:42.579536 30624 leader_election.cc:334] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561): Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:42.580343 31248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } }
I20260810 03:45:42.580684 31248 leader_election.cc:288] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 3 election: Requested vote from peers 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561), 4c104723ad384a28a4b4e73d08ee6309 (127.22.134.253:44595)
I20260810 03:45:42.581030 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.580807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42650)
0810 03:45:42.580918 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.580974 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 03:45:42.581300 30437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ceac01c98f24112b930a35ee1144d4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4c104723ad384a28a4b4e73d08ee6309"
I20260810 03:45:42.581458 30437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 2 FOLLOWER]: Advancing to term 3
I20260810 03:45:42.581869 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.581640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42658)
0810 03:45:42.581755 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.581815 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 03:45:42.581993 30624 leader_election.cc:334] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561): Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
I20260810 03:45:42.582693 30437 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ceac01c98f24112b930a35ee1144d4d in term 3.
I20260810 03:45:42.583022 30620 leader_election.cc:302] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c104723ad384a28a4b4e73d08ee6309, 5ceac01c98f24112b930a35ee1144d4d; no voters: 920d4b792c7a4e2eadd5ac2718b98534
I20260810 03:45:42.583355 31248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 3 FOLLOWER]: Leader election won for term 3
I20260810 03:45:42.583601 31248 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [term 3 LEADER]: Becoming Leader. State: Replica: 5ceac01c98f24112b930a35ee1144d4d, State: Running, Role: LEADER
I20260810 03:45:42.583913 31248 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } }
I20260810 03:45:42.585301 31251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ceac01c98f24112b930a35ee1144d4d. Latest consensus state: current_term: 3 leader_uuid: "5ceac01c98f24112b930a35ee1144d4d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:42.585407 31251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:42.585772 31253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:42.588490 31253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:42.589043 31253 catalog_manager.cc:1259] Loaded cluster ID: d0b839249aaa4de3b8ef530ff86925d0
I20260810 03:45:42.589123 31253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:42.589735 31253 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:42.590161 31253 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Loaded TSK: 0
I20260810 03:45:42.590917 31253 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:45:42.640882 30639 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:42.643956 30639 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:42.647094 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.646742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42690)
0810 03:45:42.646862 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.646924 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 03:45:42.647102 30437 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [term 3 FOLLOWER]: Refusing update from remote peer 5ceac01c98f24112b930a35ee1144d4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260810 03:45:42.647607 31248 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 03:45:42.647897 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.647649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.0.0.1:42700)
0810 03:45:42.647753 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.647831 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 03:45:42.648023 30624 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d -> Peer 920d4b792c7a4e2eadd5ac2718b98534 (127.22.134.254:43561): Couldn't send request to peer 920d4b792c7a4e2eadd5ac2718b98534. Status: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 03:45:42.649412 31255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ceac01c98f24112b930a35ee1144d4d. Latest consensus state: current_term: 3 leader_uuid: "5ceac01c98f24112b930a35ee1144d4d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:42.649557 31255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:45:42.650842 31248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "5ceac01c98f24112b930a35ee1144d4d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:42.651002 31248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:42.651373 31255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5ceac01c98f24112b930a35ee1144d4d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "920d4b792c7a4e2eadd5ac2718b98534" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43561 } } peers { permanent_uuid: "4c104723ad384a28a4b4e73d08ee6309" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 44595 } attrs { promote: false } } peers { permanent_uuid: "5ceac01c98f24112b930a35ee1144d4d" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 43203 } attrs { promote: false } } }
I20260810 03:45:42.651496 31255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c104723ad384a28a4b4e73d08ee6309 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:45:42.662101 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.657245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42133 (local address 127.0.0.1:38632)
0810 03:45:42.657348 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.657365 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:42.657460 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:42.658422 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:42.658425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:42.658442 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:42.658545 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.658551 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.659563 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.659566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.660728 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.660766 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.661666 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.661670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.661760 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.661798 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 03:45:42.661876 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 03:45:42.661953 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 03:45:42.662405 31265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.657843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:37497 (local address 127.0.0.1:38306)
0810 03:45:42.658406 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.658424 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:42.658524 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:42.658962 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:42.658965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:42.658991 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:42.659096 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.659101 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.660018 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.660021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.661035 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.661045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.661939 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.661943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.662034 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.662061 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 03:45:42.662155 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 03:45:42.662245 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":33,"spinlock_wait_cycles":5760,"thread_start_us":118,"threads_started":1}
I20260810 03:45:42.662685 31264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.657984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38306 (local address 127.22.134.195:37497)
0810 03:45:42.658224 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:42.658229 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:42.658610 (+ 381us) server_negotiation.cc:407] Connection header received
0810 03:45:42.658672 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:42.658678 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:42.658750 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:42.658836 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:42.659219 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.659894 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.661184 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.661825 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.661930 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.661977 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:42.662187 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 03:45:42.662471 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":77,"threads_started":1}
I20260810 03:45:42.662776 31263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.658167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40889 (local address 127.0.0.1:36184)
0810 03:45:42.658869 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.658883 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:42.658990 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:42.659307 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:42.659310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:42.659325 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:42.659404 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.659409 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.660221 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.660224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.661323 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.661331 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.662349 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.662352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.662442 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.662474 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:45:42.662536 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 03:45:42.662609 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":111,"threads_started":1}
I20260810 03:45:42.662802 31262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.657432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38632 (local address 127.22.134.193:42133)
0810 03:45:42.658179 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:42.658185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:42.658199 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:45:42.658255 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:42.658257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:42.658302 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:42.658411 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:42.658669 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.659449 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.660863 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.661521 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.662484 (+ 963us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.662538 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:42.662574 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 03:45:42.662656 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":100,"threads_started":1}
I20260810 03:45:42.663215 30765 tablet_service.cc:1467] Processing CreateTablet for tablet 1a045db78ee74d31a3831ad4407930fb (DEFAULT_TABLE table=test-table [id=68673ea24f35410fa69586daf1c727a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:42.663215 31081 tablet_service.cc:1467] Processing CreateTablet for tablet 1a045db78ee74d31a3831ad4407930fb (DEFAULT_TABLE table=test-table [id=68673ea24f35410fa69586daf1c727a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:42.663462 31266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.658537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36184 (local address 127.22.134.194:40889)
0810 03:45:42.658842 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:42.658846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:42.658970 (+ 124us) server_negotiation.cc:407] Connection header received
0810 03:45:42.659071 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:42.659074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:42.659122 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:42.659201 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:42.659528 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.660104 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.661460 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.662137 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.663167 (+ 1030us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.663207 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:42.663236 (+ 29us) server_negotiation.cc:299] Negotiation successful
0810 03:45:42.663292 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":147,"threads_started":1}
I20260810 03:45:42.663520 31081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a045db78ee74d31a3831ad4407930fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:42.663520 30765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a045db78ee74d31a3831ad4407930fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:42.663966 30919 tablet_service.cc:1467] Processing CreateTablet for tablet 1a045db78ee74d31a3831ad4407930fb (DEFAULT_TABLE table=test-table [id=68673ea24f35410fa69586daf1c727a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:42.664292 30919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a045db78ee74d31a3831ad4407930fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:42.666215 31267 tablet_bootstrap.cc:492] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110: Bootstrap starting.
I20260810 03:45:42.666643 31268 tablet_bootstrap.cc:492] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: Bootstrap starting.
I20260810 03:45:42.666741 31270 tablet_bootstrap.cc:492] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: Bootstrap starting.
I20260810 03:45:42.667472 31267 tablet_bootstrap.cc:654] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:42.667567 31268 tablet_bootstrap.cc:654] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:42.667650 31270 tablet_bootstrap.cc:654] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:42.669008 31267 tablet_bootstrap.cc:492] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110: No bootstrap required, opened a new log
I20260810 03:45:42.669102 31267 ts_tablet_manager.cc:1397] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:42.669236 31268 tablet_bootstrap.cc:492] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: No bootstrap required, opened a new log
I20260810 03:45:42.669252 31270 tablet_bootstrap.cc:492] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: No bootstrap required, opened a new log
I20260810 03:45:42.669312 31268 ts_tablet_manager.cc:1397] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:42.669317 31270 ts_tablet_manager.cc:1397] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 03:45:42.669652 31270 raft_consensus.cc:348] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.669616 31267 raft_consensus.cc:348] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.669731 31270 raft_consensus.cc:374] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:42.669737 31267 raft_consensus.cc:374] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:42.669679 31268 raft_consensus.cc:348] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.669754 31270 raft_consensus.cc:729] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8dc07c362654e9c9d7063e080866e89, State: Initialized, Role: FOLLOWER
I20260810 03:45:42.669770 31267 raft_consensus.cc:729] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59ba3b64635d487cbe632425bf9ff110, State: Initialized, Role: FOLLOWER
I20260810 03:45:42.669778 31268 raft_consensus.cc:374] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:42.669816 31268 raft_consensus.cc:729] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c40d4d1baba47fb929dde9445e76f40, State: Initialized, Role: FOLLOWER
I20260810 03:45:42.669889 31270 consensus_queue.cc:260] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.669906 31267 consensus_queue.cc:260] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.669934 31268 consensus_queue.cc:260] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.670280 31270 ts_tablet_manager.cc:1428] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:42.670290 31268 ts_tablet_manager.cc:1428] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:42.670290 31267 ts_tablet_manager.cc:1428] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:42.670855 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.670547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:51365)
0810 03:45:42.670718 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.670777 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260810 03:45:42.671425 31245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.671170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:36465)
0810 03:45:42.671311 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.671361 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260810 03:45:42.671875 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.671616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:38555)
0810 03:45:42.671768 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.671821 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260810 03:45:42.673975 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.673557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:32863)
0810 03:45:42.673853 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.673907 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227}
I20260810 03:45:42.674554 30998 heartbeater.cc:503] Master 127.22.134.252:43203 was elected leader, sending a full tablet report...
I20260810 03:45:42.674901 30841 heartbeater.cc:503] Master 127.22.134.252:43203 was elected leader, sending a full tablet report...
I20260810 03:45:42.675231 31156 heartbeater.cc:503] Master 127.22.134.252:43203 was elected leader, sending a full tablet report...
I20260810 03:45:42.675846 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.675604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:50999)
0810 03:45:42.675742 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.675795 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 03:45:42.676090 31245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.675831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:53949)
0810 03:45:42.675969 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.676025 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 03:45:42.764325 31275 raft_consensus.cc:482] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:42.764478 31275 raft_consensus.cc:504] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.765643 31275 leader_election.cc:288] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59ba3b64635d487cbe632425bf9ff110 (127.22.134.193:42133), 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497)
I20260810 03:45:42.769573 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.765884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:37497 (local address 127.22.134.194:59621)
0810 03:45:42.766033 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.766052 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:42.766174 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:42.766475 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:42.766477 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:42.766498 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:42.766638 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.766644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.767506 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.767510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.768348 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.768358 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.769105 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.769109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.769227 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.769248 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 03:45:42.769349 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 03:45:42.769424 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 03:45:42.769573 31264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.766039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:59621 (local address 127.22.134.195:37497)
0810 03:45:42.766242 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:42.766249 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:42.766268 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:45:42.766325 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:42.766328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:42.766365 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:42.766458 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:42.766757 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.767402 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.768480 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.768952 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.769104 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.769174 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:42.769364 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 03:45:42.769436 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:45:42.769749 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.765886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42133 (local address 127.22.134.194:37615)
0810 03:45:42.766482 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.766494 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:42.766608 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:42.766869 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:42.766872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:42.766888 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:42.767005 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.767011 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.767750 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.767755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.768558 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:42.768567 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.769291 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.769295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:42.769408 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.769437 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:45:42.769527 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 03:45:42.769599 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"mutex_wait_us":242,"thread_start_us":144,"threads_started":1}
I20260810 03:45:42.769735 31262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.765978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:37615 (local address 127.22.134.193:42133)
0810 03:45:42.766111 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:42.766115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:42.766576 (+ 461us) server_negotiation.cc:407] Connection header received
0810 03:45:42.766719 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:42.766722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:42.766764 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:42.766850 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:42.767111 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.767638 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.768688 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.769162 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.769298 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.769354 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:42.769545 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 03:45:42.769631 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:45:42.770157 31102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a045db78ee74d31a3831ad4407930fb" candidate_uuid: "b8dc07c362654e9c9d7063e080866e89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c40d4d1baba47fb929dde9445e76f40" is_pre_election: true
I20260810 03:45:42.770345 31102 raft_consensus.cc:2454] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8dc07c362654e9c9d7063e080866e89 in term 0.
I20260810 03:45:42.770304 30786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a045db78ee74d31a3831ad4407930fb" candidate_uuid: "b8dc07c362654e9c9d7063e080866e89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59ba3b64635d487cbe632425bf9ff110" is_pre_election: true
I20260810 03:45:42.770602 30786 raft_consensus.cc:2454] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8dc07c362654e9c9d7063e080866e89 in term 0.
I20260810 03:45:42.770784 30867 leader_election.cc:302] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c40d4d1baba47fb929dde9445e76f40, b8dc07c362654e9c9d7063e080866e89; no voters:
I20260810 03:45:42.771107 31275 raft_consensus.cc:2781] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:42.771207 31275 raft_consensus.cc:482] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:42.771236 31275 raft_consensus.cc:3037] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:42.772281 31275 raft_consensus.cc:504] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.772672 31275 leader_election.cc:288] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [CANDIDATE]: Term 1 election: Requested vote from peers 59ba3b64635d487cbe632425bf9ff110 (127.22.134.193:42133), 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497)
I20260810 03:45:42.772977 30786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a045db78ee74d31a3831ad4407930fb" candidate_uuid: "b8dc07c362654e9c9d7063e080866e89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59ba3b64635d487cbe632425bf9ff110"
I20260810 03:45:42.773108 30786 raft_consensus.cc:3037] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:42.773131 31102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a045db78ee74d31a3831ad4407930fb" candidate_uuid: "b8dc07c362654e9c9d7063e080866e89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c40d4d1baba47fb929dde9445e76f40"
I20260810 03:45:42.773275 31102 raft_consensus.cc:3037] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:42.774148 30786 raft_consensus.cc:2454] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8dc07c362654e9c9d7063e080866e89 in term 1.
I20260810 03:45:42.774247 31102 raft_consensus.cc:2454] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8dc07c362654e9c9d7063e080866e89 in term 1.
I20260810 03:45:42.774427 30869 leader_election.cc:302] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59ba3b64635d487cbe632425bf9ff110, b8dc07c362654e9c9d7063e080866e89; no voters:
I20260810 03:45:42.774609 31275 raft_consensus.cc:2781] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:42.774844 31275 raft_consensus.cc:686] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 1 LEADER]: Becoming Leader. State: Replica: b8dc07c362654e9c9d7063e080866e89, State: Running, Role: LEADER
I20260810 03:45:42.775310 31275 consensus_queue.cc:237] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } }
I20260810 03:45:42.775575 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.775320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:49525)
0810 03:45:42.775430 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.775487 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 03:45:42.777832 30637 catalog_manager.cc:5495] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8dc07c362654e9c9d7063e080866e89 (127.22.134.194). New cstate: current_term: 1 leader_uuid: "b8dc07c362654e9c9d7063e080866e89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8dc07c362654e9c9d7063e080866e89" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40889 } health_report { overall_health: HEALTHY } } }
I20260810 03:45:42.816244 31266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.812583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36200 (local address 127.22.134.194:40889)
0810 03:45:42.812796 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:42.812799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:42.812812 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:42.812889 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:42.812891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:42.812946 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:42.813035 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:42.813291 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.813881 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.814684 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:42.814890 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:42.814967 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:42.815267 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:42.815778 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:42.815896 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:42.815994 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 03:45:42.816049 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 03:45:42.819070 31102 raft_consensus.cc:1261] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 1 FOLLOWER]: Refusing update from remote peer b8dc07c362654e9c9d7063e080866e89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:42.819319 30786 raft_consensus.cc:1261] T 1a045db78ee74d31a3831ad4407930fb P 59ba3b64635d487cbe632425bf9ff110 [term 1 FOLLOWER]: Refusing update from remote peer b8dc07c362654e9c9d7063e080866e89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:42.819656 31279 consensus_queue.cc:1035] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c40d4d1baba47fb929dde9445e76f40" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:42.819936 31275 consensus_queue.cc:1035] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59ba3b64635d487cbe632425bf9ff110" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:42.821758 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.821431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:56019)
0810 03:45:42.821600 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.821661 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260810 03:45:42.822947 31245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.822571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:32981)
0810 03:45:42.822817 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.822874 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
I20260810 03:45:42.825309 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.825034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:57335)
0810 03:45:42.825166 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.825231 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 03:45:42.826443 31245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.826136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.195:60739)
0810 03:45:42.826325 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.826376 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260810 03:45:42.828110 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.827901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.194:50377)
0810 03:45:42.827997 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.828048 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 03:45:42.835390 30638 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:42.835579 30638 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:42.837152 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:42.836846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43561 (local address 127.22.134.193:46463)
0810 03:45:42.836986 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.837055 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:43561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 03:45:42.839975 30638 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ceac01c98f24112b930a35ee1144d4d: Sending DeleteTablet for 3 replicas of tablet 1a045db78ee74d31a3831ad4407930fb
I20260810 03:45:42.840711 31081 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a045db78ee74d31a3831ad4407930fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:42 UTC) from {username='oryx', principal='oryx/127.22.134.252@KRBTEST.COM'} at 127.0.0.1:38306
I20260810 03:45:42.840909 30919 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a045db78ee74d31a3831ad4407930fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:42 UTC) from {username='oryx', principal='oryx/127.22.134.252@KRBTEST.COM'} at 127.0.0.1:36184
I20260810 03:45:42.841586 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 30585
I20260810 03:45:42.841710 30765 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a045db78ee74d31a3831ad4407930fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:42 UTC) from {username='oryx', principal='oryx/127.22.134.252@KRBTEST.COM'} at 127.0.0.1:38632
I20260810 03:45:42.841780 30764 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a045db78ee74d31a3831ad4407930fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:42 UTC) from {username='oryx', principal='oryx/127.22.134.252@KRBTEST.COM'} at 127.0.0.1:38632
I20260810 03:45:42.848945 31300 tablet_replica.cc:330] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: stopping tablet replica
I20260810 03:45:42.849123 31300 raft_consensus.cc:2229] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:42.849267 31300 raft_consensus.cc:2258] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:42.849627 31301 tablet_replica.cc:330] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: stopping tablet replica
I20260810 03:45:42.849750 31301 raft_consensus.cc:2229] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:42.850066 31301 raft_consensus.cc:2258] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:42.850081 31300 ts_tablet_manager.cc:1905] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:42.850880 31301 ts_tablet_manager.cc:1905] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:42.852882 31300 ts_tablet_manager.cc:1918] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:42.853048 31300 log.cc:1196] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/1a045db78ee74d31a3831ad4407930fb
I20260810 03:45:42.853417 31300 ts_tablet_manager.cc:1939] T 1a045db78ee74d31a3831ad4407930fb P 9c40d4d1baba47fb929dde9445e76f40: Deleting consensus metadata
I20260810 03:45:42.853722 31301 ts_tablet_manager.cc:1918] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:42.853866 31301 log.cc:1196] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/1a045db78ee74d31a3831ad4407930fb
I20260810 03:45:42.854243 31301 ts_tablet_manager.cc:1939] T 1a045db78ee74d31a3831ad4407930fb P b8dc07c362654e9c9d7063e080866e89: Deleting consensus metadata
I20260810 03:45:42.854405 30621 catalog_manager.cc:4841] TS 9c40d4d1baba47fb929dde9445e76f40 (127.22.134.195:37497): tablet 1a045db78ee74d31a3831ad4407930fb (table test-table [id=68673ea24f35410fa69586daf1c727a9]) successfully deleted
I20260810 03:45:42.855000 30622 catalog_manager.cc:4841] TS b8dc07c362654e9c9d7063e080866e89 (127.22.134.194:40889): tablet 1a045db78ee74d31a3831ad4407930fb (table test-table [id=68673ea24f35410fa69586daf1c727a9]) successfully deleted
W20260810 03:45:42.855552 31263 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:42.855085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42133 (local address 127.0.0.1:38642)
0810 03:45:42.855229 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:42.855245 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:42.855334 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:42.855436 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:42133: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 03:45:42.855741 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 30849
W20260810 03:45:42.855806 30624 catalog_manager.cc:4584] TS 59ba3b64635d487cbe632425bf9ff110 (127.22.134.193:42133): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1a045db78ee74d31a3831ad4407930fb: Network error: Client connection negotiation failed: client connection to 127.22.134.193:42133: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260810 03:45:42.864425 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 31004
I20260810 03:45:42.872695 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 30270
I20260810 03:45:42.880463 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 30386
2026-08-10T03:45:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7683 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:42 dist-test-slave-qg60 krb5kdc[31304](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:42 dist-test-slave-qg60 krb5kdc[31304](info): set up 2 sockets
Aug 10 03:45:42 dist-test-slave-qg60 krb5kdc[31304](info): commencing operation
krb5kdc: starting...
W20260810 03:45:44.023797 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:44 dist-test-slave-qg60 krb5kdc[31304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:44Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.254.keytab.
Entry for principal oryx/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.254.keytab.
I20260810 03:45:44.165573 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:43827
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.254.keytab
--principal=oryx/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:43827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:44.282153 31318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:44.282456 31318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:44.282508 31318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:44.286692 31318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:44.286765 31318 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 03:45:44.286783 31318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:44.286803 31318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:44.286819 31318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:44.286887 31318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:44.292589 31318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:43827
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.254.keytab
--principal=oryx/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:43827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:44.293793 31318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:44.294883 31318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:44.304540 31324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:44.304632 31318 server_base.cc:1034] running on GCE node
W20260810 03:45:44.304564 31327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:44.304600 31323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:44.305713 31318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:44.306979 31318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:44.308192 31318 hybrid_clock.cc:648] HybridClock initialized: now 1786333544308163 us; error 44 us; skew 500 ppm
Aug 10 03:45:44 dist-test-slave-qg60 krb5kdc[31304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333544, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:44.317276 31318 init.cc:377] Logged in from keytab as oryx/127.22.134.254@KRBTEST.COM (short username oryx)
I20260810 03:45:44.318352 31318 webserver.cc:460] Webserver started at http://127.22.134.254:42461/ using document root <none> and password file <none>
I20260810 03:45:44.319001 31318 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:44.319105 31318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:44.319361 31318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:44.321705 31318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "09572b7d9cd046b78ca82ac6b9f4d76d"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "bf55ea251ee8ac4df21ef4941e98c009"
server_key_iv: "511963c7f2017a2a69419e0af7b0d072"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.322329 31318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "09572b7d9cd046b78ca82ac6b9f4d76d"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "bf55ea251ee8ac4df21ef4941e98c009"
server_key_iv: "511963c7f2017a2a69419e0af7b0d072"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.326341 31318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:44.329005 31334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:44.330320 31318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:45:44.330476 31318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "09572b7d9cd046b78ca82ac6b9f4d76d"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "bf55ea251ee8ac4df21ef4941e98c009"
server_key_iv: "511963c7f2017a2a69419e0af7b0d072"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.330603 31318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:44.352105 31318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:44.355281 31318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:44.355504 31318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:44.364590 31318 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:43827
I20260810 03:45:44.364614 31401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:43827 every 8 connection(s)
I20260810 03:45:44.365664 31318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:44.368592 31402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:44.373780 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 31318
I20260810 03:45:44.373927 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:44.374269 23067 external_mini_cluster.cc:1428] Setting key 957fc00f34c28667d834debe34b2ea23
I20260810 03:45:44.374872 31402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: Bootstrap starting.
I20260810 03:45:44.378000 31402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:44.379040 31402 log.cc:824] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:44.381575 31402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: No bootstrap required, opened a new log
Aug 10 03:45:44 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:44.386273 31402 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09572b7d9cd046b78ca82ac6b9f4d76d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43827 } }
I20260810 03:45:44.386533 31402 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:44.386818 31402 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09572b7d9cd046b78ca82ac6b9f4d76d, State: Initialized, Role: FOLLOWER
I20260810 03:45:44.387428 31402 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09572b7d9cd046b78ca82ac6b9f4d76d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43827 } }
I20260810 03:45:44.387639 31402 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:44.387710 31402 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:44.387814 31402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:44.389178 31402 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09572b7d9cd046b78ca82ac6b9f4d76d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43827 } }
I20260810 03:45:44.389581 31402 leader_election.cc:302] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09572b7d9cd046b78ca82ac6b9f4d76d; no voters:
I20260810 03:45:44.389964 31402 leader_election.cc:288] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:44.390175 31407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:44.390429 31407 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [term 1 LEADER]: Becoming Leader. State: Replica: 09572b7d9cd046b78ca82ac6b9f4d76d, State: Running, Role: LEADER
I20260810 03:45:44.390882 31407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09572b7d9cd046b78ca82ac6b9f4d76d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43827 } }
I20260810 03:45:44.391386 31402 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:44.392153 31407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09572b7d9cd046b78ca82ac6b9f4d76d. Latest consensus state: current_term: 1 leader_uuid: "09572b7d9cd046b78ca82ac6b9f4d76d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09572b7d9cd046b78ca82ac6b9f4d76d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43827 } } }
I20260810 03:45:44.392246 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.375944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51432 (local address 127.22.134.254:43827)
0810 03:45:44.376459 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:44.376480 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:44.376538 (+ 58us) server_negotiation.cc:407] Connection header received
0810 03:45:44.377537 (+ 999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:44.377564 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:44.378035 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:44.378470 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:44.379208 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.380815 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.381893 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.382615 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.382781 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.385685 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:44.385691 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:44.385705 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:44.385733 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:44.388184 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.388641 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.388653 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.388660 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.388865 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.389211 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.389214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.389216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.389848 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:44.390081 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:44.390909 (+ 828us) server_negotiation.cc:299] Negotiation successful
0810 03:45:44.391246 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":150,"threads_started":1}
I20260810 03:45:44.393119 31407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:44.394424 31408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09572b7d9cd046b78ca82ac6b9f4d76d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09572b7d9cd046b78ca82ac6b9f4d76d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 43827 } } }
I20260810 03:45:44.395360 31408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d [sys.catalog]: This master's current role is: LEADER
W20260810 03:45:44.396255 31423 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:44.396348 31423 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:44.396428 31421 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:44.397437 31421 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:44.403458 31421 catalog_manager.cc:1347] Generated new cluster ID: d8a360fd5a554a81b9f11999b0d3a3bd
I20260810 03:45:44.403579 31421 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:44.414615 31421 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:44.415750 31421 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:44.425627 31421 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: Generated new TSK 0
I20260810 03:45:44.426556 31421 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab.
Entry for principal oryx/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab.
I20260810 03:45:44.460847 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43827
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab
--principal=oryx/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:44.580343 31429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:44.580651 31429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:44.580699 31429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:44.584947 31429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:44.585031 31429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:44.585072 31429 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:44.585105 31429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:44.590667 31429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab
--principal=oryx/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:43827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:44.591931 31429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:44.593155 31429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:44.603591 31436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:44.603591 31439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:44.603650 31437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:44.603812 31429 server_base.cc:1034] running on GCE node
I20260810 03:45:44.604405 31429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:44.605230 31429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:44.606444 31429 hybrid_clock.cc:648] HybridClock initialized: now 1786333544606432 us; error 35 us; skew 500 ppm
Aug 10 03:45:44 dist-test-slave-qg60 krb5kdc[31304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333544, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:44.609485 31429 init.cc:377] Logged in from keytab as oryx/127.22.134.193@KRBTEST.COM (short username oryx)
I20260810 03:45:44.610530 31429 webserver.cc:460] Webserver started at http://127.22.134.193:37115/ using document root <none> and password file <none>
I20260810 03:45:44.611117 31429 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:44.611223 31429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:44.611467 31429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:44.613790 31429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "7611de91dd2c4c1288966bae321c4b1e"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "83590ef1ad954b0bed1fc1ac1e251098"
server_key_iv: "a2d29bbef6ebd69dc7f427a1c9a54adc"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.614389 31429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "7611de91dd2c4c1288966bae321c4b1e"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "83590ef1ad954b0bed1fc1ac1e251098"
server_key_iv: "a2d29bbef6ebd69dc7f427a1c9a54adc"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.618444 31429 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:45:44.621114 31447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:44.622537 31429 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:45:44.622701 31429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "7611de91dd2c4c1288966bae321c4b1e"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "83590ef1ad954b0bed1fc1ac1e251098"
server_key_iv: "a2d29bbef6ebd69dc7f427a1c9a54adc"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.622843 31429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:44.634326 31429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:44.638055 31429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:44.638283 31429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:44.639846 31429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:44.639927 31429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:44.640002 31429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:44.640045 31429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:45:44 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333544, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:44.651873 31429 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:42581
I20260810 03:45:44.652199 31573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:42581 every 8 connection(s)
I20260810 03:45:44.652951 31429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:44.655164 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.640956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:35345 (local address 127.22.134.254:43827)
0810 03:45:44.641284 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:44.641290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:44.642439 (+ 1149us) server_negotiation.cc:407] Connection header received
0810 03:45:44.643562 (+ 1123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:44.643566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:44.643627 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:44.643731 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:44.645320 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.646051 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.647365 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.647626 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.647753 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.650842 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:44.650846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:44.650848 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:44.650876 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:44.652685 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.653351 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.653357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.653361 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.653487 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.653947 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.653951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.653953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.654188 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:44.654272 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:44.654889 (+ 617us) server_negotiation.cc:299] Negotiation successful
0810 03:45:44.655020 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203}
I20260810 03:45:44.656001 31459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.641785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43827 (local address 127.22.134.193:35345)
0810 03:45:44.642276 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:44.642331 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:44.643339 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:44.643945 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:44.643951 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:44.644422 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:44.645161 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:44.645182 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.646185 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.646188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:44.647241 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:44.647251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.647802 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.647806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:44.648070 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.648827 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:44.648847 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:44.650644 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:44.652852 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:44.652858 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:44.652873 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:44.653205 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:44.653611 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:44.653616 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:44.653620 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:44.653815 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:44.654352 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:44.654357 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:44.654618 (+ 261us) client_negotiation.cc:769] Sending connection context
0810 03:45:44.654773 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 03:45:44.655077 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":127,"threads_started":1}
I20260810 03:45:44.657720 31574 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43827
I20260810 03:45:44.657919 31574 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:44.658519 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 31429
I20260810 03:45:44.658663 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:44.658654 31574 heartbeater.cc:511] Master 127.22.134.254:43827 requested a full tablet report, sending...
I20260810 03:45:44.659035 23067 external_mini_cluster.cc:1428] Setting key a97324db87bf6121c735eb86340f3ab2
I20260810 03:45:44.660533 31351 ts_manager.cc:194] Registered new tserver with Master: 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581)
I20260810 03:45:44.661953 31351 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:35345
I20260810 03:45:44.669078 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.660364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:37241 (local address 127.22.134.254:43827)
0810 03:45:44.660482 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:44.660487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:44.660502 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:45:44.660540 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:44.660544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:44.660593 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:44.660680 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:44.661365 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.662268 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.663410 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.663794 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.663923 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.665318 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:44.665326 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:44.665332 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:44.665367 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:44.667065 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.667665 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.667667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.667669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.667753 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.668088 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.668091 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.668092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.668282 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:44.668371 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:44.668786 (+ 415us) server_negotiation.cc:299] Negotiation successful
0810 03:45:44.668907 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":44}
I20260810 03:45:44.669108 31581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.660009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43827 (local address 127.22.134.193:37241)
0810 03:45:44.660346 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:44.660365 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:44.660460 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:44.660839 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:44.660843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:44.661091 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:44.661219 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:44.661226 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.662416 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.662420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:44.663268 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:44.663279 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.663938 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.663942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:44.664029 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.664714 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:44.664784 (+ 70us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:44.665168 (+ 384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:44.667203 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:44.667210 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:44.667216 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:44.667535 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:44.667850 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:44.667854 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:44.667858 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:44.667960 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:44.668391 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:44.668394 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:44.668511 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 03:45:44.668632 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 03:45:44.668828 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for oryx/127.22.134.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab.
Entry for principal oryx/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab.
I20260810 03:45:44.692767 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43827
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab
--principal=oryx/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:44.813050 31584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:44.813335 31584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:44.813380 31584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:44.817641 31584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:44.817706 31584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:44.817747 31584 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:44.817780 31584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:44.823617 31584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab
--principal=oryx/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:43827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:44.824785 31584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:44.825846 31584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:44.836575 31590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:44.836592 31593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:44.836789 31584 server_base.cc:1034] running on GCE node
W20260810 03:45:44.836604 31591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:44.837437 31584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:44.838196 31584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:44.839396 31584 hybrid_clock.cc:648] HybridClock initialized: now 1786333544839359 us; error 49 us; skew 500 ppm
Aug 10 03:45:44 dist-test-slave-qg60 krb5kdc[31304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333544, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:44.842579 31584 init.cc:377] Logged in from keytab as oryx/127.22.134.194@KRBTEST.COM (short username oryx)
I20260810 03:45:44.843763 31584 webserver.cc:460] Webserver started at http://127.22.134.194:35083/ using document root <none> and password file <none>
I20260810 03:45:44.844328 31584 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:44.844389 31584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:44.844564 31584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:44.846819 31584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "ba7d37e4871843eca1bd87d57767621c"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "a703fc47da4cc73cb50e050c618d470b"
server_key_iv: "344d27d6f280f4bc879f34969552ad7f"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.847352 31584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "ba7d37e4871843eca1bd87d57767621c"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "a703fc47da4cc73cb50e050c618d470b"
server_key_iv: "344d27d6f280f4bc879f34969552ad7f"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.851455 31584 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260810 03:45:44.854235 31602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:44.855551 31584 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:44.855708 31584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "ba7d37e4871843eca1bd87d57767621c"
format_stamp: "Formatted at 2026-08-10 03:45:44 on dist-test-slave-qg60"
server_key: "a703fc47da4cc73cb50e050c618d470b"
server_key_iv: "344d27d6f280f4bc879f34969552ad7f"
server_key_version: "encryptionkey@0"
I20260810 03:45:44.855840 31584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:44.874776 31584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:44.878163 31584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:44.878401 31584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:44.880053 31584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:44.880187 31584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:44.880264 31584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:44.880288 31584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:45:44 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333544, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:44.891918 31584 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:41801
I20260810 03:45:44.892014 31726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:41801 every 8 connection(s)
I20260810 03:45:44.893342 31584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:44.895565 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.880809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:34037 (local address 127.22.134.254:43827)
0810 03:45:44.880940 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:44.880950 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:44.882066 (+ 1116us) server_negotiation.cc:407] Connection header received
0810 03:45:44.883187 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:44.883191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:44.883248 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:44.883306 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:44.884694 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.885286 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.886519 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.886810 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.886930 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.891310 (+ 4380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:44.891319 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:44.891322 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:44.891350 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:44.893314 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.894006 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.894012 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.894017 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.894151 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.894525 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.894528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.894529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.894728 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:44.894811 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:44.895328 (+ 517us) server_negotiation.cc:299] Negotiation successful
0810 03:45:44.895439 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 03:45:44.896461 31614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.881387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43827 (local address 127.22.134.194:34037)
0810 03:45:44.881902 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:44.881947 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:44.882917 (+ 970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:44.883732 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:44.883738 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:44.884066 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:44.884534 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:44.884546 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.885424 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.885427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:44.886395 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:44.886404 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.886973 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.886977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:44.887227 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.888084 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:44.888111 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:44.891110 (+ 2999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:44.893465 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:44.893472 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:44.893489 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:44.893868 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:44.894242 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:44.894245 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:44.894247 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:44.894417 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:44.894822 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:44.894827 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:44.895053 (+ 226us) client_negotiation.cc:769] Sending connection context
0810 03:45:44.895276 (+ 223us) client_negotiation.cc:240] Negotiation successful
0810 03:45:44.895537 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":142,"threads_started":1}
I20260810 03:45:44.897722 31727 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43827
I20260810 03:45:44.897886 31727 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:44.898555 31727 heartbeater.cc:511] Master 127.22.134.254:43827 requested a full tablet report, sending...
I20260810 03:45:44.899578 31352 ts_manager.cc:194] Registered new tserver with Master: ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801)
I20260810 03:45:44.900404 31352 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:34037
I20260810 03:45:44.900782 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 31584
I20260810 03:45:44.900920 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:44.901255 23067 external_mini_cluster.cc:1428] Setting key 8d29d66df066ed169f242f264ba76d21
I20260810 03:45:44.907729 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.900022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:56083 (local address 127.22.134.254:43827)
0810 03:45:44.900170 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:44.900176 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:44.900349 (+ 173us) server_negotiation.cc:407] Connection header received
0810 03:45:44.900507 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:44.900511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:44.900568 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:44.900683 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:44.901381 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.902059 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.902969 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.903201 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.903303 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.904446 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:44.904449 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:44.904452 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:44.904481 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:44.905967 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.906397 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.906401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.906403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.906484 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:44.906762 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:44.906767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:44.906769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:44.907014 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:44.907153 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:44.907445 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 03:45:44.907555 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:45:44.907739 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:44.899949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43827 (local address 127.22.134.194:56083)
0810 03:45:44.900261 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:44.900276 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:44.900373 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:44.900831 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:44.900834 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:44.901060 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:44.901251 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:44.901259 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.902180 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.902183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:44.902849 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:44.902859 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:44.903317 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:44.903321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:44.903415 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:44.903959 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:44.903974 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:44.904308 (+ 334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:44.906082 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:44.906088 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:44.906090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:44.906296 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:44.906574 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:44.906578 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:44.906580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:44.906673 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:44.907204 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:44.907206 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:44.907282 (+ 76us) client_negotiation.cc:769] Sending connection context
0810 03:45:44.907389 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 03:45:44.907541 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":20,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for oryx/127.22.134.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab.
Entry for principal oryx/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab.
I20260810 03:45:44.931665 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:43827
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab
--principal=oryx/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:45.051849 31737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:45.052125 31737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:45.052173 31737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:45.056238 31737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:45.056306 31737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:45.056345 31737 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 03:45:45.056417 31737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:45.062119 31737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab
--principal=oryx/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.134.254:43827
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:45.063212 31737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:45.064365 31737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:45.074122 31743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:45.074182 31742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:45.074122 31745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:45.074396 31737 server_base.cc:1034] running on GCE node
I20260810 03:45:45.074853 31737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:45.075459 31737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:45.076658 31737 hybrid_clock.cc:648] HybridClock initialized: now 1786333545076621 us; error 31 us; skew 500 ppm
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333545, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:45.079912 31737 init.cc:377] Logged in from keytab as oryx/127.22.134.195@KRBTEST.COM (short username oryx)
I20260810 03:45:45.080910 31737 webserver.cc:460] Webserver started at http://127.22.134.195:34405/ using document root <none> and password file <none>
I20260810 03:45:45.081475 31737 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:45.081550 31737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:45.081727 31737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:45.083866 31737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "dcee159b13b94501a8547ff98642f296"
format_stamp: "Formatted at 2026-08-10 03:45:45 on dist-test-slave-qg60"
server_key: "713593f9d962b4222889cfbce450d829"
server_key_iv: "b393adbc731258d7c5d2096a91407f55"
server_key_version: "encryptionkey@0"
I20260810 03:45:45.084393 31737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "dcee159b13b94501a8547ff98642f296"
format_stamp: "Formatted at 2026-08-10 03:45:45 on dist-test-slave-qg60"
server_key: "713593f9d962b4222889cfbce450d829"
server_key_iv: "b393adbc731258d7c5d2096a91407f55"
server_key_version: "encryptionkey@0"
I20260810 03:45:45.088429 31737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 03:45:45.091101 31753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:45.092628 31737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:45.092778 31737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "dcee159b13b94501a8547ff98642f296"
format_stamp: "Formatted at 2026-08-10 03:45:45 on dist-test-slave-qg60"
server_key: "713593f9d962b4222889cfbce450d829"
server_key_iv: "b393adbc731258d7c5d2096a91407f55"
server_key_version: "encryptionkey@0"
I20260810 03:45:45.092883 31737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:45.109220 31737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:45.112210 31737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:45.112418 31737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:45.113900 31737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:45.113979 31737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:45.114061 31737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:45.114116 31737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333545, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:45.125754 31737 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:44027
I20260810 03:45:45.125829 31882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:44027 every 8 connection(s)
I20260810 03:45:45.126766 31737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:45.129187 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 31737
I20260810 03:45:45.129354 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:45.129722 23067 external_mini_cluster.cc:1428] Setting key 5b1fb9d3f3489e0802a3e596ce7af203
I20260810 03:45:45.129825 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.114972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:58061 (local address 127.22.134.254:43827)
0810 03:45:45.115106 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.115110 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.116102 (+ 992us) server_negotiation.cc:407] Connection header received
0810 03:45:45.117241 (+ 1139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.117245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.117325 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.117393 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:45.119334 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.120279 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.122291 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.122613 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.122706 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.125721 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:45.125725 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:45.125729 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:45.125763 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:45.127554 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.128102 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.128106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.128108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.128200 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.128549 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.128552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.128554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.128798 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:45.128927 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.129457 (+ 530us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.129647 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:45:45.130545 31764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.115422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43827 (local address 127.22.134.195:58061)
0810 03:45:45.115941 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.115984 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.116980 (+ 996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.117893 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.117902 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.118432 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:45.119119 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.119137 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.120441 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.120447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.122135 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.122150 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.122806 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.122811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.123045 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.123792 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:45.123814 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:45.125493 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:45.127662 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:45.127667 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:45.127681 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:45.127989 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:45.128296 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:45.128300 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:45.128302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:45.128443 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:45.128922 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:45.128929 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:45.129178 (+ 249us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.129362 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.129634 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":144,"threads_started":1}
I20260810 03:45:45.131876 31883 heartbeater.cc:347] Connected to a master server at 127.22.134.254:43827
I20260810 03:45:45.132071 31883 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:45.132606 31883 heartbeater.cc:511] Master 127.22.134.254:43827 requested a full tablet report, sending...
I20260810 03:45:45.134236 31351 ts_manager.cc:194] Registered new tserver with Master: dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027)
I20260810 03:45:45.134899 31351 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:58061
I20260810 03:45:45.141639 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.134377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:42641 (local address 127.22.134.254:43827)
0810 03:45:45.135235 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.135239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.135253 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:45:45.135286 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.135289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.135329 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.135419 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:45.135854 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.136591 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.137517 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.137733 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.137820 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.138891 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:45.138894 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:45.138896 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:45.138917 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:45.140143 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.140506 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.140508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.140510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.140588 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.140887 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.140889 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.140890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.141129 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:45.141218 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.141435 (+ 217us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.141528 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784}
I20260810 03:45:45.141644 31889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.134308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43827 (local address 127.22.134.195:42641)
0810 03:45:45.134588 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.134600 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.134674 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.135437 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.135439 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.135636 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:45.135737 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.135743 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.136830 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.136833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.137409 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.137417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.137836 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.137838 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.137908 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.138440 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:45.138452 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:45.138764 (+ 312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:45.140240 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:45.140242 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:45.140244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:45.140424 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:45.140672 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:45.140674 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:45.140675 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:45.140804 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:45.141219 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:45.141221 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:45.141293 (+ 72us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.141374 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.141475 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":115,"threads_started":1}
I20260810 03:45:45.143930 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333545, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:45:45.170369 31405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:45.163837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51434 (local address 127.22.134.254:43827)
0810 03:45:45.163974 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.163978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.163992 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:45:45.164045 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.164049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.164096 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.164176 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:45.164973 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.165509 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.166348 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.166584 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.166673 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.170170 (+ 3497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51434: BlockingRecv error: recv got EOF from 127.0.0.1:51434 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333545, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:45.180359 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.172250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51444 (local address 127.22.134.254:43827)
0810 03:45:45.172395 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.172398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.172411 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:45.172447 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.172449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.172487 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.172568 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:45.173269 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.173792 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.174543 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.174768 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.174858 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.177593 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:45.177596 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:45.177598 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:45.177624 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:45.178872 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.179274 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.179277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.179278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.179361 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.179628 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.179631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.179632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.179823 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:45.179936 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.180131 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.180237 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:45:45.183331 31351 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:45.186496 31351 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:45.202041 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.196169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57618 (local address 127.22.134.193:42581)
0810 03:45:45.196642 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.196649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.196993 (+ 344us) server_negotiation.cc:407] Connection header received
0810 03:45:45.197069 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.197084 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.197246 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.197392 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.197772 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.198828 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.200792 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.201346 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.201500 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.201644 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.201795 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.201893 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":76,"threads_started":1}
I20260810 03:45:45.202061 31910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.195605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42581 (local address 127.0.0.1:57618)
0810 03:45:45.196797 (+ 1192us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.196810 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.196900 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.197551 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.197554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.197570 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.197654 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.197659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.198940 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.198945 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.200601 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.200612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.201486 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.201490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.201604 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.201642 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.201763 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.201893 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1111,"mutex_wait_us":136,"thread_start_us":89,"threads_started":1}
I20260810 03:45:45.202319 31912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.195586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:41801 (local address 127.0.0.1:56070)
0810 03:45:45.196173 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.196230 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.196385 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.197590 (+ 1205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.197592 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.197618 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.197726 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.197732 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.199118 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.199121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.200601 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.200612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.201807 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.201811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.201962 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.202008 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.202072 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.202180 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"mutex_wait_us":218,"spinlock_wait_cycles":896,"thread_start_us":108,"threads_started":1}
I20260810 03:45:45.202382 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.195535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54260 (local address 127.22.134.195:44027)
0810 03:45:45.196669 (+ 1134us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.196681 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.196706 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:45:45.196833 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.196842 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.197155 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.197393 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.197779 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.199029 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.200593 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.201438 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.201598 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.201739 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.202160 (+ 421us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.202248 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1043,"thread_start_us":149,"threads_started":1}
I20260810 03:45:45.202847 31909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.195340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:44027 (local address 127.0.0.1:54260)
0810 03:45:45.196173 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.196229 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.196384 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.197383 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.197392 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.197424 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.197576 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.197583 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.199171 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.199174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.200471 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.200480 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.201807 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.201811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.201958 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.201998 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.202072 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.202718 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"mutex_wait_us":469,"spinlock_wait_cycles":68992,"thread_start_us":108,"threads_started":1}
I20260810 03:45:45.203250 31914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.196164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56070 (local address 127.22.134.194:41801)
0810 03:45:45.196934 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.196946 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.196970 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:45:45.197047 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.197054 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.197293 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.197454 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.197851 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.198994 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.200760 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.201527 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.201646 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.201741 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.203008 (+ 1267us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.203108 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":115,"threads_started":1}
I20260810 03:45:45.205685 31658 tablet_service.cc:1467] Processing CreateTablet for tablet f3021e3730a9480290f18360f2cb2d7d (DEFAULT_TABLE table=test-table [id=c506db7d7145402cb27496efc33fbc05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:45.205709 31808 tablet_service.cc:1467] Processing CreateTablet for tablet f3021e3730a9480290f18360f2cb2d7d (DEFAULT_TABLE table=test-table [id=c506db7d7145402cb27496efc33fbc05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:45.205706 31499 tablet_service.cc:1467] Processing CreateTablet for tablet f3021e3730a9480290f18360f2cb2d7d (DEFAULT_TABLE table=test-table [id=c506db7d7145402cb27496efc33fbc05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:45.206749 31658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3021e3730a9480290f18360f2cb2d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.206764 31499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3021e3730a9480290f18360f2cb2d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.206769 31808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3021e3730a9480290f18360f2cb2d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.213977 31915 tablet_bootstrap.cc:492] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: Bootstrap starting.
I20260810 03:45:45.214673 31916 tablet_bootstrap.cc:492] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: Bootstrap starting.
I20260810 03:45:45.215481 31917 tablet_bootstrap.cc:492] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: Bootstrap starting.
I20260810 03:45:45.216861 31916 tablet_bootstrap.cc:654] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.216907 31915 tablet_bootstrap.cc:654] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.217530 31917 tablet_bootstrap.cc:654] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.217661 31916 log.cc:824] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:45.217931 31915 log.cc:824] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:45.218611 31917 log.cc:824] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:45.219847 31916 tablet_bootstrap.cc:492] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: No bootstrap required, opened a new log
I20260810 03:45:45.220052 31916 ts_tablet_manager.cc:1397] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 03:45:45.220151 31915 tablet_bootstrap.cc:492] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: No bootstrap required, opened a new log
I20260810 03:45:45.220337 31917 tablet_bootstrap.cc:492] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: No bootstrap required, opened a new log
I20260810 03:45:45.220332 31915 ts_tablet_manager.cc:1397] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260810 03:45:45.220530 31917 ts_tablet_manager.cc:1397] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 03:45:45.223421 31917 raft_consensus.cc:348] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.223677 31917 raft_consensus.cc:374] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.223762 31917 raft_consensus.cc:729] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcee159b13b94501a8547ff98642f296, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.224221 31917 consensus_queue.cc:260] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.224656 31916 raft_consensus.cc:348] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.224898 31883 heartbeater.cc:503] Master 127.22.134.254:43827 was elected leader, sending a full tablet report...
I20260810 03:45:45.224974 31916 raft_consensus.cc:374] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.225034 31916 raft_consensus.cc:729] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7611de91dd2c4c1288966bae321c4b1e, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.225270 31917 ts_tablet_manager.cc:1428] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260810 03:45:45.224396 31915 raft_consensus.cc:348] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.225472 31915 raft_consensus.cc:374] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.225530 31915 raft_consensus.cc:729] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7d37e4871843eca1bd87d57767621c, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.225478 31916 consensus_queue.cc:260] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.225977 31915 consensus_queue.cc:260] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.226111 31574 heartbeater.cc:503] Master 127.22.134.254:43827 was elected leader, sending a full tablet report...
I20260810 03:45:45.226991 31915 ts_tablet_manager.cc:1428] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260810 03:45:45.227362 31727 heartbeater.cc:503] Master 127.22.134.254:43827 was elected leader, sending a full tablet report...
I20260810 03:45:45.227451 31916 ts_tablet_manager.cc:1428] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 03:45:45.274529 31924 raft_consensus.cc:482] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:45.274775 31924 raft_consensus.cc:504] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.276185 31924 leader_election.cc:288] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027), ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801)
I20260810 03:45:45.280655 31914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.276646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:34103 (local address 127.22.134.194:41801)
0810 03:45:45.276806 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.276812 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.277005 (+ 193us) server_negotiation.cc:407] Connection header received
0810 03:45:45.277110 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.277114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.277184 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.277273 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.277612 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.278245 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.279453 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.279962 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.280071 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.280118 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.280412 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.280514 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:45:45.280653 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.276419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:41801 (local address 127.22.134.193:34103)
0810 03:45:45.276892 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.276906 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.277016 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.277297 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.277300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.277318 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.277474 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.277482 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.278391 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.278394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.279302 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.279313 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.280106 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.280109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.280221 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.280286 (+ 65us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.280372 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.280436 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":33,"thread_start_us":182,"threads_started":1}
I20260810 03:45:45.280771 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.276508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:37309 (local address 127.22.134.195:44027)
0810 03:45:45.276676 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.276682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.277123 (+ 441us) server_negotiation.cc:407] Connection header received
0810 03:45:45.277254 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.277260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.277313 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.277389 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.277728 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.278414 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.279608 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.280006 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.280235 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.280295 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.280528 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.280609 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 03:45:45.280864 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.276417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:44027 (local address 127.22.134.193:37309)
0810 03:45:45.276988 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.277006 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.277128 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.277424 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.277427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.277442 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.277569 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.277577 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.278544 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.278547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.279464 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.279475 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.280233 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.280236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.280376 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.280406 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.280507 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.280582 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":37,"thread_start_us":136,"threads_started":1}
I20260810 03:45:45.281473 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3021e3730a9480290f18360f2cb2d7d" candidate_uuid: "7611de91dd2c4c1288966bae321c4b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee159b13b94501a8547ff98642f296" is_pre_election: true
I20260810 03:45:45.281473 31680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3021e3730a9480290f18360f2cb2d7d" candidate_uuid: "7611de91dd2c4c1288966bae321c4b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7d37e4871843eca1bd87d57767621c" is_pre_election: true
I20260810 03:45:45.281790 31680 raft_consensus.cc:2454] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7611de91dd2c4c1288966bae321c4b1e in term 0.
I20260810 03:45:45.281795 31834 raft_consensus.cc:2454] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7611de91dd2c4c1288966bae321c4b1e in term 0.
I20260810 03:45:45.282363 31449 leader_election.cc:302] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7611de91dd2c4c1288966bae321c4b1e, ba7d37e4871843eca1bd87d57767621c, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:45.282683 31924 raft_consensus.cc:2781] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:45.282792 31924 raft_consensus.cc:482] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:45.282878 31924 raft_consensus.cc:3037] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.284090 31924 raft_consensus.cc:504] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.284497 31924 leader_election.cc:288] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [CANDIDATE]: Term 1 election: Requested vote from peers dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027), ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801)
I20260810 03:45:45.284942 31680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3021e3730a9480290f18360f2cb2d7d" candidate_uuid: "7611de91dd2c4c1288966bae321c4b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7d37e4871843eca1bd87d57767621c"
I20260810 03:45:45.285001 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3021e3730a9480290f18360f2cb2d7d" candidate_uuid: "7611de91dd2c4c1288966bae321c4b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee159b13b94501a8547ff98642f296"
I20260810 03:45:45.285097 31680 raft_consensus.cc:3037] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.285115 31834 raft_consensus.cc:3037] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.286293 31834 raft_consensus.cc:2454] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7611de91dd2c4c1288966bae321c4b1e in term 1.
I20260810 03:45:45.286296 31680 raft_consensus.cc:2454] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7611de91dd2c4c1288966bae321c4b1e in term 1.
I20260810 03:45:45.286645 31449 leader_election.cc:302] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7611de91dd2c4c1288966bae321c4b1e, ba7d37e4871843eca1bd87d57767621c; no voters:
I20260810 03:45:45.286859 31924 raft_consensus.cc:2781] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:45.287139 31924 raft_consensus.cc:686] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 1 LEADER]: Becoming Leader. State: Replica: 7611de91dd2c4c1288966bae321c4b1e, State: Running, Role: LEADER
I20260810 03:45:45.287580 31924 consensus_queue.cc:237] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } }
I20260810 03:45:45.291719 31350 catalog_manager.cc:5495] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193). New cstate: current_term: 1 leader_uuid: "7611de91dd2c4c1288966bae321c4b1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } health_report { overall_health: HEALTHY } } }
I20260810 03:45:45.325834 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.322281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57622 (local address 127.22.134.193:42581)
0810 03:45:45.322438 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.322441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.322454 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:45.322537 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.322539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.322594 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.322699 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:45.322919 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.323492 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.324303 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.324533 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.324615 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.324947 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:45.325411 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:45.325512 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.325595 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.325649 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:45:45.332186 31680 raft_consensus.cc:1261] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Refusing update from remote peer 7611de91dd2c4c1288966bae321c4b1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:45.332553 31834 raft_consensus.cc:1261] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Refusing update from remote peer 7611de91dd2c4c1288966bae321c4b1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:45.333146 31924 consensus_queue.cc:1035] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:45.333360 31928 consensus_queue.cc:1035] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:45.342206 31932 mvcc.cc:205] Tried to move back new op lower bound from 7316822201672855552 to 7316822201501233152. Current Snapshot: MvccSnapshot[applied={T|T < 7316822201672855552}]
I20260810 03:45:45.351292 31351 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:45.351461 31351 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:45.354317 31351 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: Sending DeleteTablet for 3 replicas of tablet f3021e3730a9480290f18360f2cb2d7d
I20260810 03:45:45.355283 31658 tablet_service.cc:1514] Processing DeleteTablet for tablet f3021e3730a9480290f18360f2cb2d7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:45 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:56070
I20260810 03:45:45.355319 31808 tablet_service.cc:1514] Processing DeleteTablet for tablet f3021e3730a9480290f18360f2cb2d7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:45 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:54260
I20260810 03:45:45.355540 31499 tablet_service.cc:1514] Processing DeleteTablet for tablet f3021e3730a9480290f18360f2cb2d7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:45 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:57618
I20260810 03:45:45.355831 31943 tablet_replica.cc:330] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: stopping tablet replica
I20260810 03:45:45.356213 31943 raft_consensus.cc:2229] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:45.356251 31944 tablet_replica.cc:330] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: stopping tablet replica
I20260810 03:45:45.356546 31944 raft_consensus.cc:2229] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:45.356606 31943 raft_consensus.cc:2258] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:45.356973 31351 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 03:45:45.357262 31944 raft_consensus.cc:2258] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 03:45:45.357481 31351 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:45.356030 31942 tablet_replica.cc:330] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: stopping tablet replica
I20260810 03:45:45.358168 31942 raft_consensus.cc:2229] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:45.358541 31942 raft_consensus.cc:2258] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:45.358783 31943 ts_tablet_manager.cc:1905] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:45.359722 31944 ts_tablet_manager.cc:1905] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:45.361922 31943 ts_tablet_manager.cc:1918] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:45.362059 31942 ts_tablet_manager.cc:1905] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:45.362088 31943 log.cc:1196] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/f3021e3730a9480290f18360f2cb2d7d
I20260810 03:45:45.362437 31943 ts_tablet_manager.cc:1939] T f3021e3730a9480290f18360f2cb2d7d P dcee159b13b94501a8547ff98642f296: Deleting consensus metadata
I20260810 03:45:45.363749 31337 catalog_manager.cc:4841] TS dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027): tablet f3021e3730a9480290f18360f2cb2d7d (table test-table [id=c506db7d7145402cb27496efc33fbc05]) successfully deleted
I20260810 03:45:45.364813 31499 tablet_service.cc:1467] Processing CreateTablet for tablet 694b5789d9cc43a7944f032d11a5b69c (DEFAULT_TABLE table=test-table [id=d38a525d32a749deb6fdd363f36d318e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:45.365099 31499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694b5789d9cc43a7944f032d11a5b69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.366261 31944 ts_tablet_manager.cc:1918] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:45.366353 31944 log.cc:1196] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/f3021e3730a9480290f18360f2cb2d7d
I20260810 03:45:45.366680 31944 ts_tablet_manager.cc:1939] T f3021e3730a9480290f18360f2cb2d7d P 7611de91dd2c4c1288966bae321c4b1e: Deleting consensus metadata
I20260810 03:45:45.367460 31916 tablet_bootstrap.cc:492] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: Bootstrap starting.
I20260810 03:45:45.368424 31916 tablet_bootstrap.cc:654] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.368427 31942 ts_tablet_manager.cc:1918] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:45.368536 31942 log.cc:1196] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/f3021e3730a9480290f18360f2cb2d7d
I20260810 03:45:45.368901 31942 ts_tablet_manager.cc:1939] T f3021e3730a9480290f18360f2cb2d7d P ba7d37e4871843eca1bd87d57767621c: Deleting consensus metadata
I20260810 03:45:45.369257 31808 tablet_service.cc:1467] Processing CreateTablet for tablet 694b5789d9cc43a7944f032d11a5b69c (DEFAULT_TABLE table=test-table [id=d38a525d32a749deb6fdd363f36d318e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:45.369390 31658 tablet_service.cc:1467] Processing CreateTablet for tablet 694b5789d9cc43a7944f032d11a5b69c (DEFAULT_TABLE table=test-table [id=d38a525d32a749deb6fdd363f36d318e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:45.369539 31808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694b5789d9cc43a7944f032d11a5b69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.369626 31658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 694b5789d9cc43a7944f032d11a5b69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.370098 31336 catalog_manager.cc:4841] TS ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801): tablet f3021e3730a9480290f18360f2cb2d7d (table test-table [id=c506db7d7145402cb27496efc33fbc05]) successfully deleted
I20260810 03:45:45.371835 31917 tablet_bootstrap.cc:492] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: Bootstrap starting.
I20260810 03:45:45.371922 31915 tablet_bootstrap.cc:492] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: Bootstrap starting.
I20260810 03:45:45.372848 31915 tablet_bootstrap.cc:654] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.372947 31917 tablet_bootstrap.cc:654] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.373524 31338 catalog_manager.cc:4841] TS 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581): tablet f3021e3730a9480290f18360f2cb2d7d (table test-table [id=c506db7d7145402cb27496efc33fbc05]) successfully deleted
I20260810 03:45:45.374450 31915 tablet_bootstrap.cc:492] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: No bootstrap required, opened a new log
I20260810 03:45:45.374549 31915 ts_tablet_manager.cc:1397] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 03:45:45.374784 31916 tablet_bootstrap.cc:492] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: No bootstrap required, opened a new log
I20260810 03:45:45.374863 31916 ts_tablet_manager.cc:1397] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260810 03:45:45.375016 31915 raft_consensus.cc:348] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.375119 31915 raft_consensus.cc:374] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.375151 31915 raft_consensus.cc:729] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7d37e4871843eca1bd87d57767621c, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.375273 31915 consensus_queue.cc:260] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.375327 31916 raft_consensus.cc:348] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.375448 31916 raft_consensus.cc:374] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.375481 31916 raft_consensus.cc:729] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7611de91dd2c4c1288966bae321c4b1e, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.375562 31915 ts_tablet_manager.cc:1428] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:45.375605 31916 consensus_queue.cc:260] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.375871 31916 ts_tablet_manager.cc:1428] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:45.384678 31917 tablet_bootstrap.cc:492] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: No bootstrap required, opened a new log
I20260810 03:45:45.384816 31917 ts_tablet_manager.cc:1397] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20260810 03:45:45.385330 31917 raft_consensus.cc:348] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.385447 31917 raft_consensus.cc:374] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.385486 31917 raft_consensus.cc:729] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcee159b13b94501a8547ff98642f296, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.385623 31917 consensus_queue.cc:260] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.385872 31917 ts_tablet_manager.cc:1428] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260810 03:45:45.394913 31729 tablet.cc:2369] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:45:45.404417 31575 tablet.cc:2369] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:45:45.627940 31884 tablet.cc:2369] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:45:45.670809 31925 raft_consensus.cc:482] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:45.670984 31925 raft_consensus.cc:504] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.672430 31925 leader_election.cc:288] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581), dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027)
I20260810 03:45:45.676327 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.672825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:57979 (local address 127.22.134.195:44027)
0810 03:45:45.672991 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.672997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.673045 (+ 48us) server_negotiation.cc:407] Connection header received
0810 03:45:45.673251 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.673254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.673306 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.673387 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.673723 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.674208 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.675330 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.675719 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.675853 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.675906 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.676148 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.676219 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 03:45:45.676327 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.672752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:50111 (local address 127.22.134.193:42581)
0810 03:45:45.672979 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.672986 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.673070 (+ 84us) server_negotiation.cc:407] Connection header received
0810 03:45:45.673249 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.673253 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.673306 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.673391 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.673691 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.674209 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.675301 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.675713 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.675846 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.675906 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.676105 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.676190 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260810 03:45:45.676496 31948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.672658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:44027 (local address 127.22.134.194:57979)
0810 03:45:45.672971 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.672986 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.673136 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.673408 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.673411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.673439 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.673580 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.673585 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.674321 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.674325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.675181 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.675190 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.675856 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.675859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.676000 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.676018 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.676114 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.676189 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":90,"spinlock_wait_cycles":9472,"thread_start_us":94,"threads_started":1}
I20260810 03:45:45.677049 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694b5789d9cc43a7944f032d11a5b69c" candidate_uuid: "ba7d37e4871843eca1bd87d57767621c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee159b13b94501a8547ff98642f296" is_pre_election: true
I20260810 03:45:45.677235 31834 raft_consensus.cc:2454] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7d37e4871843eca1bd87d57767621c in term 0.
I20260810 03:45:45.677315 31949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.672605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42581 (local address 127.22.134.194:50111)
0810 03:45:45.672967 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.672983 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.673134 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.673407 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.673410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.673436 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.673578 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.673583 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.674327 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.674331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.675166 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.675184 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.675841 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.675844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.675970 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.675999 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.676061 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.676157 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":7,"spinlock_wait_cycles":45056,"thread_start_us":107,"threads_started":1}
I20260810 03:45:45.677686 31606 leader_election.cc:302] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba7d37e4871843eca1bd87d57767621c, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:45.677990 31925 raft_consensus.cc:2781] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:45.678076 31925 raft_consensus.cc:482] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:45.678030 31523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694b5789d9cc43a7944f032d11a5b69c" candidate_uuid: "ba7d37e4871843eca1bd87d57767621c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7611de91dd2c4c1288966bae321c4b1e" is_pre_election: true
I20260810 03:45:45.678139 31925 raft_consensus.cc:3037] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.678335 31523 raft_consensus.cc:2454] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7d37e4871843eca1bd87d57767621c in term 0.
I20260810 03:45:45.678431 31924 raft_consensus.cc:482] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:45.678535 31924 raft_consensus.cc:504] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.678925 31924 leader_election.cc:288] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801), dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027)
I20260810 03:45:45.679234 31680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694b5789d9cc43a7944f032d11a5b69c" candidate_uuid: "7611de91dd2c4c1288966bae321c4b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7d37e4871843eca1bd87d57767621c" is_pre_election: true
I20260810 03:45:45.679272 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694b5789d9cc43a7944f032d11a5b69c" candidate_uuid: "7611de91dd2c4c1288966bae321c4b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee159b13b94501a8547ff98642f296" is_pre_election: true
I20260810 03:45:45.679400 31834 raft_consensus.cc:2454] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7611de91dd2c4c1288966bae321c4b1e in term 0.
I20260810 03:45:45.679574 31925 raft_consensus.cc:504] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.679700 31450 leader_election.cc:302] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7611de91dd2c4c1288966bae321c4b1e, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:45.679839 31680 raft_consensus.cc:2379] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7611de91dd2c4c1288966bae321c4b1e in current term 1: Already voted for candidate ba7d37e4871843eca1bd87d57767621c in this term.
I20260810 03:45:45.679869 31924 raft_consensus.cc:2781] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:45.679919 31924 raft_consensus.cc:482] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:45.679958 31924 raft_consensus.cc:3037] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.679972 31925 leader_election.cc:288] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [CANDIDATE]: Term 1 election: Requested vote from peers 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581), dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027)
I20260810 03:45:45.680321 31523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694b5789d9cc43a7944f032d11a5b69c" candidate_uuid: "ba7d37e4871843eca1bd87d57767621c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7611de91dd2c4c1288966bae321c4b1e"
I20260810 03:45:45.681125 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694b5789d9cc43a7944f032d11a5b69c" candidate_uuid: "ba7d37e4871843eca1bd87d57767621c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee159b13b94501a8547ff98642f296"
I20260810 03:45:45.681236 31834 raft_consensus.cc:3037] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.681277 31924 raft_consensus.cc:504] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.681535 31523 raft_consensus.cc:2379] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba7d37e4871843eca1bd87d57767621c in current term 1: Already voted for candidate 7611de91dd2c4c1288966bae321c4b1e in this term.
I20260810 03:45:45.681667 31924 leader_election.cc:288] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [CANDIDATE]: Term 1 election: Requested vote from peers ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801), dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027)
I20260810 03:45:45.682341 31833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694b5789d9cc43a7944f032d11a5b69c" candidate_uuid: "7611de91dd2c4c1288966bae321c4b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee159b13b94501a8547ff98642f296"
I20260810 03:45:45.682565 31834 raft_consensus.cc:2454] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7d37e4871843eca1bd87d57767621c in term 1.
I20260810 03:45:45.682945 31680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "694b5789d9cc43a7944f032d11a5b69c" candidate_uuid: "7611de91dd2c4c1288966bae321c4b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7d37e4871843eca1bd87d57767621c"
I20260810 03:45:45.682976 31606 leader_election.cc:302] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ba7d37e4871843eca1bd87d57767621c, dcee159b13b94501a8547ff98642f296; no voters: 7611de91dd2c4c1288966bae321c4b1e
I20260810 03:45:45.683171 31680 raft_consensus.cc:2379] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7611de91dd2c4c1288966bae321c4b1e in current term 1: Already voted for candidate ba7d37e4871843eca1bd87d57767621c in this term.
I20260810 03:45:45.683241 31925 raft_consensus.cc:2781] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:45.683449 31925 raft_consensus.cc:686] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 1 LEADER]: Becoming Leader. State: Replica: ba7d37e4871843eca1bd87d57767621c, State: Running, Role: LEADER
I20260810 03:45:45.683455 31449 leader_election.cc:302] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7611de91dd2c4c1288966bae321c4b1e; no voters: ba7d37e4871843eca1bd87d57767621c, dcee159b13b94501a8547ff98642f296
I20260810 03:45:45.683727 31925 consensus_queue.cc:237] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.683877 31924 raft_consensus.cc:2726] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 03:45:45.686105 31352 catalog_manager.cc:5495] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c reported cstate change: term changed from 0 to 1, leader changed from <none> to ba7d37e4871843eca1bd87d57767621c (127.22.134.194). New cstate: current_term: 1 leader_uuid: "ba7d37e4871843eca1bd87d57767621c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333544, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.254@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:45.771430 31958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.762648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:43827 (local address 127.0.0.1:51448)
0810 03:45:45.763103 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.763121 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.763238 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.763542 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.763544 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.763945 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:45.764049 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.764055 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.764956 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.764958 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.765544 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.765552 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.765991 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.765994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.766053 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.766657 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:45.766668 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:45.768142 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:45.769804 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:45.769812 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:45.769817 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:45.770068 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:45.770360 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:45.770362 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:45.770363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:45.770446 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:45.770879 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:45.770887 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:45.771001 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.771099 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.771232 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":142,"threads_started":1}
I20260810 03:45:45.771436 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.762680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51448 (local address 127.22.134.254:43827)
0810 03:45:45.762961 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.762968 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.763204 (+ 236us) server_negotiation.cc:407] Connection header received
0810 03:45:45.763329 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.763332 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.763376 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.763471 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:45.764210 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.764852 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.765668 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.765890 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.765969 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.768282 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:45.768285 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:45.768287 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:45.768308 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:45.769699 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.770197 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.770200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.770201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.770276 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.770527 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.770529 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.770530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.770759 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:45.770839 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.771156 (+ 317us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.771298 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":210,"thread_start_us":121,"threads_started":1}
I20260810 03:45:45.775660 31352 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:51448:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 03:45:45.776440 31352 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:45.781338 31499 tablet_service.cc:1467] Processing CreateTablet for tablet 8a89b95ca94040c19a7ab89d56318d96 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b21adf2145134534818ff1534aafd5b7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:45.781361 31658 tablet_service.cc:1467] Processing CreateTablet for tablet 8a89b95ca94040c19a7ab89d56318d96 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b21adf2145134534818ff1534aafd5b7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:45.781533 31808 tablet_service.cc:1467] Processing CreateTablet for tablet 8a89b95ca94040c19a7ab89d56318d96 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b21adf2145134534818ff1534aafd5b7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 03:45:45.781769 31658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a89b95ca94040c19a7ab89d56318d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.781769 31499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a89b95ca94040c19a7ab89d56318d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.781888 31808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a89b95ca94040c19a7ab89d56318d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:45.784216 31917 tablet_bootstrap.cc:492] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: Bootstrap starting.
I20260810 03:45:45.784577 31915 tablet_bootstrap.cc:492] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: Bootstrap starting.
I20260810 03:45:45.784703 31916 tablet_bootstrap.cc:492] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: Bootstrap starting.
I20260810 03:45:45.785331 31917 tablet_bootstrap.cc:654] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.785647 31915 tablet_bootstrap.cc:654] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.785642 31916 tablet_bootstrap.cc:654] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:45.786665 31917 tablet_bootstrap.cc:492] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: No bootstrap required, opened a new log
I20260810 03:45:45.786762 31917 ts_tablet_manager.cc:1397] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 03:45:45.786839 31915 tablet_bootstrap.cc:492] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: No bootstrap required, opened a new log
I20260810 03:45:45.786844 31916 tablet_bootstrap.cc:492] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: No bootstrap required, opened a new log
I20260810 03:45:45.786931 31916 ts_tablet_manager.cc:1397] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:45.786937 31915 ts_tablet_manager.cc:1397] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:45.787240 31917 raft_consensus.cc:348] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.787369 31917 raft_consensus.cc:374] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.787305 31916 raft_consensus.cc:348] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.787408 31917 raft_consensus.cc:729] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcee159b13b94501a8547ff98642f296, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.787367 31915 raft_consensus.cc:348] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.787441 31916 raft_consensus.cc:374] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.787469 31915 raft_consensus.cc:374] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:45.787478 31916 raft_consensus.cc:729] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7611de91dd2c4c1288966bae321c4b1e, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.787510 31915 raft_consensus.cc:729] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7d37e4871843eca1bd87d57767621c, State: Initialized, Role: FOLLOWER
I20260810 03:45:45.787551 31917 consensus_queue.cc:260] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.787606 31916 consensus_queue.cc:260] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.787629 31915 consensus_queue.cc:260] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.787830 31917 ts_tablet_manager.cc:1428] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:45.787883 31915 ts_tablet_manager.cc:1428] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:45.787914 31916 ts_tablet_manager.cc:1428] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:45.788033 31923 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.788051 31925 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.788170 31925 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:45.788170 31923 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:45.788138 31924 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.788254 31924 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:45.804209 31923 raft_consensus.cc:482] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:45.804363 31923 raft_consensus.cc:504] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.805634 31923 leader_election.cc:288] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581), ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801)
I20260810 03:45:45.809741 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.805941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:42465 (local address 127.22.134.193:42581)
0810 03:45:45.806080 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.806084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.806265 (+ 181us) server_negotiation.cc:407] Connection header received
0810 03:45:45.806486 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.806493 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.806552 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.806634 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.806938 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.807484 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.808660 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.809161 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.809259 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.809341 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.809525 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.809611 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:45:45.809762 31963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.805838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:42581 (local address 127.22.134.195:42465)
0810 03:45:45.806161 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.806173 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.806349 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.806662 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.806667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.806686 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.806830 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.806836 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.807597 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.807602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.808531 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.808540 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.809283 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.809290 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.809384 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.809417 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.809487 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.809570 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":21,"thread_start_us":84,"threads_started":1}
I20260810 03:45:45.809816 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.805990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:41207 (local address 127.22.134.194:41801)
0810 03:45:45.806361 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.806370 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.806385 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:45:45.806545 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.806547 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.806585 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.806693 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:45:45.807015 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.807519 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.808688 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.809194 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.809333 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.809390 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.809600 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.809674 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":221,"threads_started":1}
I20260810 03:45:45.809782 31964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.805852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:41801 (local address 127.22.134.195:41207)
0810 03:45:45.806311 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.806332 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.806431 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.806717 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.806721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.806739 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:45:45.806901 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.806907 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.807689 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.807692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.808537 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.808546 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.809340 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.809344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.809449 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.809486 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.809570 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.809643 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":51,"thread_start_us":74,"threads_started":1}
I20260810 03:45:45.810392 31523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a89b95ca94040c19a7ab89d56318d96" candidate_uuid: "dcee159b13b94501a8547ff98642f296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7611de91dd2c4c1288966bae321c4b1e" is_pre_election: true
I20260810 03:45:45.810565 31523 raft_consensus.cc:2454] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcee159b13b94501a8547ff98642f296 in term 0.
I20260810 03:45:45.810631 31680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a89b95ca94040c19a7ab89d56318d96" candidate_uuid: "dcee159b13b94501a8547ff98642f296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7d37e4871843eca1bd87d57767621c" is_pre_election: true
I20260810 03:45:45.810761 31680 raft_consensus.cc:2454] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcee159b13b94501a8547ff98642f296 in term 0.
I20260810 03:45:45.810932 31758 leader_election.cc:302] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7611de91dd2c4c1288966bae321c4b1e, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:45.811244 31923 raft_consensus.cc:2781] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:45.811331 31923 raft_consensus.cc:482] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:45.811386 31923 raft_consensus.cc:3037] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.812430 31923 raft_consensus.cc:504] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.812891 31923 leader_election.cc:288] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [CANDIDATE]: Term 1 election: Requested vote from peers 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581), ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801)
I20260810 03:45:45.813194 31523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a89b95ca94040c19a7ab89d56318d96" candidate_uuid: "dcee159b13b94501a8547ff98642f296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7611de91dd2c4c1288966bae321c4b1e"
I20260810 03:45:45.813351 31523 raft_consensus.cc:3037] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.813330 31680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a89b95ca94040c19a7ab89d56318d96" candidate_uuid: "dcee159b13b94501a8547ff98642f296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7d37e4871843eca1bd87d57767621c"
I20260810 03:45:45.813445 31680 raft_consensus.cc:3037] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:45.814565 31523 raft_consensus.cc:2454] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcee159b13b94501a8547ff98642f296 in term 1.
I20260810 03:45:45.814565 31680 raft_consensus.cc:2454] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcee159b13b94501a8547ff98642f296 in term 1.
I20260810 03:45:45.814926 31758 leader_election.cc:302] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7611de91dd2c4c1288966bae321c4b1e, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:45.815100 31923 raft_consensus.cc:2781] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:45.815331 31923 raft_consensus.cc:686] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [term 1 LEADER]: Becoming Leader. State: Replica: dcee159b13b94501a8547ff98642f296, State: Running, Role: LEADER
I20260810 03:45:45.815588 31923 consensus_queue.cc:237] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:45.816954 31966 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: TxnStatusTablet state changed. Reason: New leader dcee159b13b94501a8547ff98642f296. Latest consensus state: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.817114 31966 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:45.817672 31969 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 03:45:45.817855 31969 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 03:45:45.818240 31351 catalog_manager.cc:5495] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcee159b13b94501a8547ff98642f296 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260810 03:45:45.836822 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.832267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54270 (local address 127.22.134.195:44027)
0810 03:45:45.832397 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.832401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.832418 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:45:45.832585 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.832589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.832689 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.832809 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:45.833056 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.833877 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.835194 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.835432 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.835517 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.835869 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:45.836360 (+ 491us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:45.836450 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.836588 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.836646 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:45:45.836849 31958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.832141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:44027 (local address 127.0.0.1:54270)
0810 03:45:45.832321 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.832338 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.832445 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.832842 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.832845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.832852 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:45.832952 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.832956 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.834043 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.834047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.835051 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.835062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.835553 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.835557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.835662 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.835722 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:45.836464 (+ 742us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:45.836480 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.836560 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.836668 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 03:45:45.840088 31680 raft_consensus.cc:1261] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Refusing update from remote peer dcee159b13b94501a8547ff98642f296: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:45.840220 31523 raft_consensus.cc:1261] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Refusing update from remote peer dcee159b13b94501a8547ff98642f296: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:45.840605 31966 consensus_queue.cc:1035] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:45.840801 31923 consensus_queue.cc:1035] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:45.842449 31925 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: TxnStatusTablet state changed. Reason: New leader dcee159b13b94501a8547ff98642f296. Latest consensus state: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.842571 31925 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:45.842604 31924 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: TxnStatusTablet state changed. Reason: New leader dcee159b13b94501a8547ff98642f296. Latest consensus state: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.842718 31924 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:45.844799 31923 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.844986 31923 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:45.845301 31925 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.845412 31925 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P ba7d37e4871843eca1bd87d57767621c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:45.846148 31933 mvcc.cc:205] Tried to move back new op lower bound from 7316822203755720704 to 7316822203663233024. Current Snapshot: MvccSnapshot[applied={T|T < 7316822203755720704}]
I20260810 03:45:45.855096 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.850915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56074 (local address 127.22.134.194:41801)
0810 03:45:45.851033 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.851037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.851241 (+ 204us) server_negotiation.cc:407] Connection header received
0810 03:45:45.851392 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.851394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.851446 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.851534 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:45.851819 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.852324 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.853572 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.853791 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.853868 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.854197 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:45.854662 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:45.854748 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.854860 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.854912 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 03:45:45.856964 31966 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.857146 31966 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P dcee159b13b94501a8547ff98642f296: This TxnStatusTablet replica's current role is: LEADER
I20260810 03:45:45.858722 31924 tablet_replica.cc:439] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } } }
I20260810 03:45:45.858875 31924 tablet_replica.cc:442] T 8a89b95ca94040c19a7ab89d56318d96 P 7611de91dd2c4c1288966bae321c4b1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 03:45:45.866803 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.863188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:33485 (local address 127.22.134.195:44027)
0810 03:45:45.863333 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.863340 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.863594 (+ 254us) server_negotiation.cc:407] Connection header received
0810 03:45:45.863769 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.863772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.863827 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.863902 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:45.864203 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.864735 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.865682 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.865925 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.866038 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.866334 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:45.866420 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:45.866503 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.866593 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.866655 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:45:45.867141 31986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.863118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:44027 (local address 127.22.134.194:33485)
0810 03:45:45.863498 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.863511 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.863653 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.863926 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.863929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.863937 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:45.864092 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.864098 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.864885 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.864892 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.865552 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.865561 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.866044 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.866047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.866149 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.866194 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:45.866509 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:45.866518 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.866583 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.866664 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":102,"threads_started":1}
I20260810 03:45:45.874469 31834 raft_consensus.cc:1261] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Refusing update from remote peer ba7d37e4871843eca1bd87d57767621c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:45.874496 31523 raft_consensus.cc:1261] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Refusing update from remote peer ba7d37e4871843eca1bd87d57767621c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:45.874943 31950 consensus_queue.cc:1035] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:45.875145 31925 consensus_queue.cc:1035] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:45.883893 31972 mvcc.cc:205] Tried to move back new op lower bound from 7316822203897311232 to 7316822203123298304. Current Snapshot: MvccSnapshot[applied={T|T < 7316822203897311232}]
I20260810 03:45:45.899303 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.895260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:43435 (local address 127.22.134.194:41801)
0810 03:45:45.895378 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.895382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.895600 (+ 218us) server_negotiation.cc:407] Connection header received
0810 03:45:45.895701 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.895704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.895755 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.895837 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:45.896135 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.896916 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.898205 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.898407 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.898485 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.898864 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:45.898931 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:45.898990 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.899090 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.899163 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:45:45.899338 31991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.895186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:41801 (local address 127.22.134.195:43435)
0810 03:45:45.895515 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:45.895530 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:45.895627 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:45.895839 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:45.895841 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:45.895846 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 03:45:45.896004 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.896011 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.897022 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.897026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.898073 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:45.898083 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.898535 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.898538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:45.898642 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.898697 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 03:45:45.899013 (+ 316us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 03:45:45.899019 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:45:45.899080 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 03:45:45.899161 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":120,"threads_started":1}
I20260810 03:45:45.930352 31351 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:45.930545 31351 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:45.933185 31351 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: Sending DeleteTablet for 3 replicas of tablet 694b5789d9cc43a7944f032d11a5b69c
I20260810 03:45:45.933828 31499 tablet_service.cc:1514] Processing DeleteTablet for tablet 694b5789d9cc43a7944f032d11a5b69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:45 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:57618
I20260810 03:45:45.934005 31658 tablet_service.cc:1514] Processing DeleteTablet for tablet 694b5789d9cc43a7944f032d11a5b69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:45 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:56070
I20260810 03:45:45.934093 31808 tablet_service.cc:1514] Processing DeleteTablet for tablet 694b5789d9cc43a7944f032d11a5b69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:45 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:54260
I20260810 03:45:45.934844 31995 tablet_replica.cc:330] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: stopping tablet replica
I20260810 03:45:45.935036 31996 tablet_replica.cc:330] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: stopping tablet replica
I20260810 03:45:45.935218 31996 raft_consensus.cc:2229] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:45.935418 31996 raft_consensus.cc:2258] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:45.936261 31996 ts_tablet_manager.cc:1905] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:45.935020 31995 raft_consensus.cc:2229] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:45.939260 31995 raft_consensus.cc:2258] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:45.939891 31996 ts_tablet_manager.cc:1918] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:45.940016 31995 ts_tablet_manager.cc:1905] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:45.940034 31996 log.cc:1196] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/694b5789d9cc43a7944f032d11a5b69c
I20260810 03:45:45.940412 31996 ts_tablet_manager.cc:1939] T 694b5789d9cc43a7944f032d11a5b69c P dcee159b13b94501a8547ff98642f296: Deleting consensus metadata
I20260810 03:45:45.941313 31337 catalog_manager.cc:4841] TS dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027): tablet 694b5789d9cc43a7944f032d11a5b69c (table test-table [id=d38a525d32a749deb6fdd363f36d318e]) successfully deleted
I20260810 03:45:45.943581 31995 ts_tablet_manager.cc:1918] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:45.943682 31995 log.cc:1196] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/694b5789d9cc43a7944f032d11a5b69c
I20260810 03:45:45.943990 31995 ts_tablet_manager.cc:1939] T 694b5789d9cc43a7944f032d11a5b69c P ba7d37e4871843eca1bd87d57767621c: Deleting consensus metadata
I20260810 03:45:45.944808 31336 catalog_manager.cc:4841] TS ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801): tablet 694b5789d9cc43a7944f032d11a5b69c (table test-table [id=d38a525d32a749deb6fdd363f36d318e]) successfully deleted
I20260810 03:45:45.944941 31994 tablet_replica.cc:330] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: stopping tablet replica
I20260810 03:45:45.945123 31994 raft_consensus.cc:2229] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:45.945276 31994 raft_consensus.cc:2258] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:45.945988 31994 ts_tablet_manager.cc:1905] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:45.948956 31994 ts_tablet_manager.cc:1918] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:45.949061 31994 log.cc:1196] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/694b5789d9cc43a7944f032d11a5b69c
I20260810 03:45:45.949329 31994 ts_tablet_manager.cc:1939] T 694b5789d9cc43a7944f032d11a5b69c P 7611de91dd2c4c1288966bae321c4b1e: Deleting consensus metadata
I20260810 03:45:45.950282 31338 catalog_manager.cc:4841] TS 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581): tablet 694b5789d9cc43a7944f032d11a5b69c (table test-table [id=d38a525d32a749deb6fdd363f36d318e]) successfully deleted
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:45:45.982266 31957 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:45.973688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51456 (local address 127.22.134.254:43827)
0810 03:45:45.973841 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.973846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.974155 (+ 309us) server_negotiation.cc:407] Connection header received
0810 03:45:45.974294 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.974298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.974373 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.974471 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:45.975421 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.976310 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.977644 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.978017 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.978143 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.982092 (+ 3949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51456: BlockingRecv error: recv got EOF from 127.0.0.1:51456 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 10 03:45:45 dist-test-slave-qg60 krb5kdc[31304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM
I20260810 03:45:45.995958 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:45.984512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51458 (local address 127.22.134.254:43827)
0810 03:45:45.984654 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:45.984659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:45.985148 (+ 489us) server_negotiation.cc:407] Connection header received
0810 03:45:45.985276 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:45.985279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:45.985340 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:45.985435 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:45.986231 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.987026 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.988203 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:45.988543 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:45.988679 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:45.991935 (+ 3256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:45.991939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:45.991942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:45.991975 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:45.993938 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.994478 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.994482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.994484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.994584 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:45.994897 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:45.994901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:45.994902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:45.995136 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:45.995271 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:45.995572 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 03:45:45.995717 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:45:45.999512 31351 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51458:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:46.000341 31351 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:46.006062 31499 tablet_service.cc:1467] Processing CreateTablet for tablet 0c812d73b9a6457291f563c642152116 (DEFAULT_TABLE table=test-table [id=ba70a20df0f446b59ef09690482c8de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:46.006425 31499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c812d73b9a6457291f563c642152116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:46.009047 31916 tablet_bootstrap.cc:492] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: Bootstrap starting.
I20260810 03:45:46.009269 31658 tablet_service.cc:1467] Processing CreateTablet for tablet 0c812d73b9a6457291f563c642152116 (DEFAULT_TABLE table=test-table [id=ba70a20df0f446b59ef09690482c8de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:46.009567 31658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c812d73b9a6457291f563c642152116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:46.010078 31916 tablet_bootstrap.cc:654] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:46.011488 31916 tablet_bootstrap.cc:492] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: No bootstrap required, opened a new log
I20260810 03:45:46.011571 31916 ts_tablet_manager.cc:1397] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 03:45:46.012048 31915 tablet_bootstrap.cc:492] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: Bootstrap starting.
I20260810 03:45:46.011997 31916 raft_consensus.cc:348] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.012115 31916 raft_consensus.cc:374] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:46.012146 31916 raft_consensus.cc:729] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7611de91dd2c4c1288966bae321c4b1e, State: Initialized, Role: FOLLOWER
I20260810 03:45:46.012269 31916 consensus_queue.cc:260] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.012521 31916 ts_tablet_manager.cc:1428] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260810 03:45:46.013091 31915 tablet_bootstrap.cc:654] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:46.014204 31808 tablet_service.cc:1467] Processing CreateTablet for tablet 0c812d73b9a6457291f563c642152116 (DEFAULT_TABLE table=test-table [id=ba70a20df0f446b59ef09690482c8de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:46.014506 31808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c812d73b9a6457291f563c642152116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:46.017176 31917 tablet_bootstrap.cc:492] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: Bootstrap starting.
I20260810 03:45:46.018165 31917 tablet_bootstrap.cc:654] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:46.019251 31915 tablet_bootstrap.cc:492] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: No bootstrap required, opened a new log
I20260810 03:45:46.019352 31915 ts_tablet_manager.cc:1397] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 03:45:46.019498 31917 tablet_bootstrap.cc:492] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: No bootstrap required, opened a new log
I20260810 03:45:46.019635 31917 ts_tablet_manager.cc:1397] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 03:45:46.019846 31915 raft_consensus.cc:348] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.019980 31915 raft_consensus.cc:374] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:46.020010 31915 raft_consensus.cc:729] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7d37e4871843eca1bd87d57767621c, State: Initialized, Role: FOLLOWER
I20260810 03:45:46.020017 31917 raft_consensus.cc:348] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.020148 31917 raft_consensus.cc:374] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:46.020182 31917 raft_consensus.cc:729] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcee159b13b94501a8547ff98642f296, State: Initialized, Role: FOLLOWER
I20260810 03:45:46.020309 31917 consensus_queue.cc:260] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.020545 31917 ts_tablet_manager.cc:1428] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 03:45:46.022709 31915 consensus_queue.cc:260] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.023291 31915 ts_tablet_manager.cc:1428] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260810 03:45:46.146245 31982 raft_consensus.cc:482] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:46.146435 31982 raft_consensus.cc:504] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.146957 31982 leader_election.cc:288] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581), ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801)
I20260810 03:45:46.147373 31680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c812d73b9a6457291f563c642152116" candidate_uuid: "dcee159b13b94501a8547ff98642f296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7d37e4871843eca1bd87d57767621c" is_pre_election: true
I20260810 03:45:46.147485 31523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c812d73b9a6457291f563c642152116" candidate_uuid: "dcee159b13b94501a8547ff98642f296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7611de91dd2c4c1288966bae321c4b1e" is_pre_election: true
I20260810 03:45:46.147567 31680 raft_consensus.cc:2454] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcee159b13b94501a8547ff98642f296 in term 0.
I20260810 03:45:46.147684 31523 raft_consensus.cc:2454] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcee159b13b94501a8547ff98642f296 in term 0.
I20260810 03:45:46.147877 31755 leader_election.cc:302] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba7d37e4871843eca1bd87d57767621c, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:46.148063 31982 raft_consensus.cc:2781] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:46.148123 31982 raft_consensus.cc:482] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:46.148185 31982 raft_consensus.cc:3037] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:46.149274 31982 raft_consensus.cc:504] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.149647 31982 leader_election.cc:288] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [CANDIDATE]: Term 1 election: Requested vote from peers 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581), ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801)
I20260810 03:45:46.150197 31523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c812d73b9a6457291f563c642152116" candidate_uuid: "dcee159b13b94501a8547ff98642f296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7611de91dd2c4c1288966bae321c4b1e"
I20260810 03:45:46.150206 31680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c812d73b9a6457291f563c642152116" candidate_uuid: "dcee159b13b94501a8547ff98642f296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba7d37e4871843eca1bd87d57767621c"
I20260810 03:45:46.150346 31523 raft_consensus.cc:3037] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:46.150363 31680 raft_consensus.cc:3037] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:46.151368 31523 raft_consensus.cc:2454] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcee159b13b94501a8547ff98642f296 in term 1.
I20260810 03:45:46.151413 31680 raft_consensus.cc:2454] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcee159b13b94501a8547ff98642f296 in term 1.
I20260810 03:45:46.151716 31758 leader_election.cc:302] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7611de91dd2c4c1288966bae321c4b1e, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:46.151901 31982 raft_consensus.cc:2781] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:46.151993 31982 raft_consensus.cc:686] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 1 LEADER]: Becoming Leader. State: Replica: dcee159b13b94501a8547ff98642f296, State: Running, Role: LEADER
I20260810 03:45:46.152179 31982 consensus_queue.cc:237] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.153975 31351 catalog_manager.cc:5495] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcee159b13b94501a8547ff98642f296 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "dcee159b13b94501a8547ff98642f296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20260810 03:45:46.184899 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:46.181857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54272 (local address 127.22.134.195:44027)
0810 03:45:46.181995 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:46.181999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:46.182030 (+ 31us) server_negotiation.cc:407] Connection header received
0810 03:45:46.182077 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:46.182079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:46.182124 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:46.182184 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:46.182419 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:46.183005 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:46.183829 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:46.184065 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:46.184172 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:46.184417 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:46.184485 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:46.184538 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:46.184642 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 03:45:46.184690 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:45:46.187248 31680 raft_consensus.cc:1261] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Refusing update from remote peer dcee159b13b94501a8547ff98642f296: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:46.187259 31523 raft_consensus.cc:1261] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Refusing update from remote peer dcee159b13b94501a8547ff98642f296: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:46.187736 31982 consensus_queue.cc:1035] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:46.187978 31966 consensus_queue.cc:1035] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:46.198098 31350 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:46.198249 31350 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:46.201120 31350 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: Sending DeleteTablet for 3 replicas of tablet 0c812d73b9a6457291f563c642152116
I20260810 03:45:46.201931 31658 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c812d73b9a6457291f563c642152116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:46 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:56070
I20260810 03:45:46.202033 31499 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c812d73b9a6457291f563c642152116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:46 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:57618
I20260810 03:45:46.202098 31501 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c812d73b9a6457291f563c642152116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:46 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:57618
I20260810 03:45:46.202148 31995 tablet_replica.cc:330] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: stopping tablet replica
I20260810 03:45:46.202270 31995 raft_consensus.cc:2229] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:46.202443 31995 raft_consensus.cc:2258] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:46.202661 31994 tablet_replica.cc:330] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: stopping tablet replica
I20260810 03:45:46.202800 31994 raft_consensus.cc:2229] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:46.202955 31994 raft_consensus.cc:2258] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:46.203418 31808 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c812d73b9a6457291f563c642152116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:46 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:54260
I20260810 03:45:46.203604 31996 tablet_replica.cc:330] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: stopping tablet replica
I20260810 03:45:46.203725 31996 raft_consensus.cc:2229] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:46.203753 31995 ts_tablet_manager.cc:1905] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:46.203948 31994 ts_tablet_manager.cc:1905] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:46.204057 31996 raft_consensus.cc:2258] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:46.204434 31350 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51458:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:45:46.204948 31350 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:45:46.206540 31994 ts_tablet_manager.cc:1918] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:46.206558 31995 ts_tablet_manager.cc:1918] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:46.206614 31994 log.cc:1196] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/0c812d73b9a6457291f563c642152116
I20260810 03:45:46.206638 31995 log.cc:1196] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/0c812d73b9a6457291f563c642152116
I20260810 03:45:46.206878 31994 ts_tablet_manager.cc:1939] T 0c812d73b9a6457291f563c642152116 P 7611de91dd2c4c1288966bae321c4b1e: Deleting consensus metadata
I20260810 03:45:46.206926 31995 ts_tablet_manager.cc:1939] T 0c812d73b9a6457291f563c642152116 P ba7d37e4871843eca1bd87d57767621c: Deleting consensus metadata
I20260810 03:45:46.207891 31338 catalog_manager.cc:4841] TS 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581): tablet 0c812d73b9a6457291f563c642152116 (table test-table [id=ba70a20df0f446b59ef09690482c8de4]) successfully deleted
I20260810 03:45:46.207892 31336 catalog_manager.cc:4841] TS ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801): tablet 0c812d73b9a6457291f563c642152116 (table test-table [id=ba70a20df0f446b59ef09690482c8de4]) successfully deleted
W20260810 03:45:46.208828 31338 catalog_manager.cc:4808] TS 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581): delete failed for tablet 0c812d73b9a6457291f563c642152116 because the tablet was not found. No further retry: Not found: Tablet not found: 0c812d73b9a6457291f563c642152116
I20260810 03:45:46.209477 31996 ts_tablet_manager.cc:1905] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:46.210458 31501 tablet_service.cc:1467] Processing CreateTablet for tablet 1fdede1e3d994b529430637023aec61c (DEFAULT_TABLE table=test-table [id=2fbe84e062a14349ae0945c82ab78fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:46.210633 31658 tablet_service.cc:1467] Processing CreateTablet for tablet 1fdede1e3d994b529430637023aec61c (DEFAULT_TABLE table=test-table [id=2fbe84e062a14349ae0945c82ab78fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:46.210765 31501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fdede1e3d994b529430637023aec61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:46.210884 31658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fdede1e3d994b529430637023aec61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:46.212090 31996 ts_tablet_manager.cc:1918] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:45:46.212168 31996 log.cc:1196] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/0c812d73b9a6457291f563c642152116
I20260810 03:45:46.212445 31996 ts_tablet_manager.cc:1939] T 0c812d73b9a6457291f563c642152116 P dcee159b13b94501a8547ff98642f296: Deleting consensus metadata
I20260810 03:45:46.213366 31808 tablet_service.cc:1467] Processing CreateTablet for tablet 1fdede1e3d994b529430637023aec61c (DEFAULT_TABLE table=test-table [id=2fbe84e062a14349ae0945c82ab78fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:45:46.213615 31808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fdede1e3d994b529430637023aec61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:46.215750 31917 tablet_bootstrap.cc:492] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: Bootstrap starting.
I20260810 03:45:46.215801 31916 tablet_bootstrap.cc:492] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: Bootstrap starting.
I20260810 03:45:46.216508 31917 tablet_bootstrap.cc:654] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:46.216604 31916 tablet_bootstrap.cc:654] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:46.216886 31337 catalog_manager.cc:4841] TS dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027): tablet 0c812d73b9a6457291f563c642152116 (table test-table [id=ba70a20df0f446b59ef09690482c8de4]) successfully deleted
I20260810 03:45:46.217711 31917 tablet_bootstrap.cc:492] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: No bootstrap required, opened a new log
I20260810 03:45:46.217754 31916 tablet_bootstrap.cc:492] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: No bootstrap required, opened a new log
I20260810 03:45:46.217797 31917 ts_tablet_manager.cc:1397] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:46.217839 31916 ts_tablet_manager.cc:1397] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:46.218196 31917 raft_consensus.cc:348] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.218307 31917 raft_consensus.cc:374] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:46.218338 31917 raft_consensus.cc:729] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcee159b13b94501a8547ff98642f296, State: Initialized, Role: FOLLOWER
I20260810 03:45:46.218259 31916 raft_consensus.cc:348] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.218392 31916 raft_consensus.cc:374] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:46.218431 31916 raft_consensus.cc:729] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7611de91dd2c4c1288966bae321c4b1e, State: Initialized, Role: FOLLOWER
I20260810 03:45:46.218452 31917 consensus_queue.cc:260] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.218550 31916 consensus_queue.cc:260] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.218695 31917 ts_tablet_manager.cc:1428] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:46.218824 31916 ts_tablet_manager.cc:1428] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:45:46.218871 31915 tablet_bootstrap.cc:492] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: Bootstrap starting.
I20260810 03:45:46.219777 31915 tablet_bootstrap.cc:654] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:46.221189 31915 tablet_bootstrap.cc:492] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: No bootstrap required, opened a new log
I20260810 03:45:46.221307 31915 ts_tablet_manager.cc:1397] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 03:45:46.221791 31915 raft_consensus.cc:348] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.221920 31915 raft_consensus.cc:374] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:46.221966 31915 raft_consensus.cc:729] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7d37e4871843eca1bd87d57767621c, State: Initialized, Role: FOLLOWER
I20260810 03:45:46.222098 31915 consensus_queue.cc:260] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.222384 31915 ts_tablet_manager.cc:1428] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 03:45:46.234536 31925 raft_consensus.cc:482] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:45:46.234719 31925 raft_consensus.cc:504] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.235309 31925 leader_election.cc:288] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581), dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027)
I20260810 03:45:46.235735 31523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fdede1e3d994b529430637023aec61c" candidate_uuid: "ba7d37e4871843eca1bd87d57767621c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7611de91dd2c4c1288966bae321c4b1e" is_pre_election: true
I20260810 03:45:46.235759 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fdede1e3d994b529430637023aec61c" candidate_uuid: "ba7d37e4871843eca1bd87d57767621c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee159b13b94501a8547ff98642f296" is_pre_election: true
I20260810 03:45:46.235922 31834 raft_consensus.cc:2454] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7d37e4871843eca1bd87d57767621c in term 0.
I20260810 03:45:46.235924 31523 raft_consensus.cc:2454] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7d37e4871843eca1bd87d57767621c in term 0.
I20260810 03:45:46.236212 31606 leader_election.cc:302] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba7d37e4871843eca1bd87d57767621c, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:46.236426 31925 raft_consensus.cc:2781] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:45:46.236516 31925 raft_consensus.cc:482] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:45:46.236595 31925 raft_consensus.cc:3037] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:46.237890 31925 raft_consensus.cc:504] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.238318 31925 leader_election.cc:288] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [CANDIDATE]: Term 1 election: Requested vote from peers 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581), dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027)
I20260810 03:45:46.238631 31523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fdede1e3d994b529430637023aec61c" candidate_uuid: "ba7d37e4871843eca1bd87d57767621c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7611de91dd2c4c1288966bae321c4b1e"
I20260810 03:45:46.238765 31523 raft_consensus.cc:3037] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:46.238819 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fdede1e3d994b529430637023aec61c" candidate_uuid: "ba7d37e4871843eca1bd87d57767621c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcee159b13b94501a8547ff98642f296"
I20260810 03:45:46.238932 31834 raft_consensus.cc:3037] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:46.239908 31834 raft_consensus.cc:2454] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7d37e4871843eca1bd87d57767621c in term 1.
I20260810 03:45:46.239969 31523 raft_consensus.cc:2454] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7d37e4871843eca1bd87d57767621c in term 1.
I20260810 03:45:46.240228 31606 leader_election.cc:302] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba7d37e4871843eca1bd87d57767621c, dcee159b13b94501a8547ff98642f296; no voters:
I20260810 03:45:46.240411 31925 raft_consensus.cc:2781] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:46.240527 31925 raft_consensus.cc:686] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 1 LEADER]: Becoming Leader. State: Replica: ba7d37e4871843eca1bd87d57767621c, State: Running, Role: LEADER
I20260810 03:45:46.240679 31925 consensus_queue.cc:237] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } }
I20260810 03:45:46.242535 31351 catalog_manager.cc:5495] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c reported cstate change: term changed from 0 to 1, leader changed from <none> to ba7d37e4871843eca1bd87d57767621c (127.22.134.194). New cstate: current_term: 1 leader_uuid: "ba7d37e4871843eca1bd87d57767621c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7d37e4871843eca1bd87d57767621c" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20260810 03:45:46.262408 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:46.258998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56088 (local address 127.22.134.194:41801)
0810 03:45:46.259114 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:46.259119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:46.259133 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:45:46.259296 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:46.259299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:46.259339 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:46.259418 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:45:46.259679 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:46.260341 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:46.261364 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:46.261582 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:46.261699 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:46.261956 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:45:46.262029 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:45:46.262110 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:46.262207 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 03:45:46.262256 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 03:45:46.269229 31523 raft_consensus.cc:1261] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Refusing update from remote peer ba7d37e4871843eca1bd87d57767621c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:46.269896 31925 consensus_queue.cc:1035] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7611de91dd2c4c1288966bae321c4b1e" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 42581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:46.269970 31834 raft_consensus.cc:1261] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Refusing update from remote peer ba7d37e4871843eca1bd87d57767621c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:45:46.270579 31925 consensus_queue.cc:1035] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcee159b13b94501a8547ff98642f296" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:45:46.307176 31350 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:46.307329 31350 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:45:46.309556 31350 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09572b7d9cd046b78ca82ac6b9f4d76d: Sending DeleteTablet for 3 replicas of tablet 1fdede1e3d994b529430637023aec61c
I20260810 03:45:46.310252 31501 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fdede1e3d994b529430637023aec61c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:46 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:57618
I20260810 03:45:46.310479 31994 tablet_replica.cc:330] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: stopping tablet replica
I20260810 03:45:46.310643 31994 raft_consensus.cc:2229] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:46.310765 31994 raft_consensus.cc:2258] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:46.310999 31658 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fdede1e3d994b529430637023aec61c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:46 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:56070
I20260810 03:45:46.311179 31995 tablet_replica.cc:330] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: stopping tablet replica
I20260810 03:45:46.311304 31995 raft_consensus.cc:2229] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:45:46.311501 31995 raft_consensus.cc:2258] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:46.312144 31808 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fdede1e3d994b529430637023aec61c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:45:46 UTC) from {username='oryx', principal='oryx/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:54260
I20260810 03:45:46.312218 31995 ts_tablet_manager.cc:1905] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:46.312335 31996 tablet_replica.cc:330] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: stopping tablet replica
I20260810 03:45:46.312436 31996 raft_consensus.cc:2229] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:45:46.312548 31996 raft_consensus.cc:2258] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:45:46.312564 31994 ts_tablet_manager.cc:1905] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:46.314414 31995 ts_tablet_manager.cc:1918] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:46.314473 31995 log.cc:1196] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/1fdede1e3d994b529430637023aec61c
I20260810 03:45:46.314684 31995 ts_tablet_manager.cc:1939] T 1fdede1e3d994b529430637023aec61c P ba7d37e4871843eca1bd87d57767621c: Deleting consensus metadata
I20260810 03:45:46.315007 31994 ts_tablet_manager.cc:1918] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:46.315088 31994 log.cc:1196] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/1fdede1e3d994b529430637023aec61c
I20260810 03:45:46.315353 31994 ts_tablet_manager.cc:1939] T 1fdede1e3d994b529430637023aec61c P 7611de91dd2c4c1288966bae321c4b1e: Deleting consensus metadata
I20260810 03:45:46.315817 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 31429
I20260810 03:45:46.318966 31336 catalog_manager.cc:4841] TS ba7d37e4871843eca1bd87d57767621c (127.22.134.194:41801): tablet 1fdede1e3d994b529430637023aec61c (table test-table [id=2fbe84e062a14349ae0945c82ab78fdf]) successfully deleted
I20260810 03:45:46.321024 31996 ts_tablet_manager.cc:1905] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:45:46.321426 31338 catalog_manager.cc:4841] TS 7611de91dd2c4c1288966bae321c4b1e (127.22.134.193:42581): tablet 1fdede1e3d994b529430637023aec61c (table test-table [id=2fbe84e062a14349ae0945c82ab78fdf]) successfully deleted
I20260810 03:45:46.323200 31996 ts_tablet_manager.cc:1918] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 03:45:46.323307 31996 log.cc:1196] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/1fdede1e3d994b529430637023aec61c
I20260810 03:45:46.323576 31996 ts_tablet_manager.cc:1939] T 1fdede1e3d994b529430637023aec61c P dcee159b13b94501a8547ff98642f296: Deleting consensus metadata
I20260810 03:45:46.324358 31337 catalog_manager.cc:4841] TS dcee159b13b94501a8547ff98642f296 (127.22.134.195:44027): tablet 1fdede1e3d994b529430637023aec61c (table test-table [id=2fbe84e062a14349ae0945c82ab78fdf]) successfully deleted
I20260810 03:45:46.330287 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 31584
I20260810 03:45:46.341982 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 31737
I20260810 03:45:46.352324 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 31318
2026-08-10T03:45:46Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3470 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:46 dist-test-slave-qg60 krb5kdc[32028](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:46 dist-test-slave-qg60 krb5kdc[32028](info): set up 2 sockets
Aug 10 03:45:46 dist-test-slave-qg60 krb5kdc[32028](info): commencing operation
krb5kdc: starting...
W20260810 03:45:47.465291 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:47 dist-test-slave-qg60 krb5kdc[32028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:47.608882 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:37471
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:37471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:47.726197 32043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:47.726491 32043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:47.726539 32043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:47.730527 32043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:47.730597 32043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:47.730618 32043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:47.730634 32043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:47.730649 32043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:47.736166 32043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:37471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:37471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:47.737300 32043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:47.738307 32043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:47.747650 32052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:47.747641 32049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:47.747641 32048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:47.748135 32043 server_base.cc:1034] running on GCE node
I20260810 03:45:47.748806 32043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:47.749992 32043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:47.751176 32043 hybrid_clock.cc:648] HybridClock initialized: now 1786333547751145 us; error 44 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T03:45:47Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1403 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:45:47 dist-test-slave-qg60 krb5kdc[32057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:45:47 dist-test-slave-qg60 krb5kdc[32057](info): set up 2 sockets
Aug 10 03:45:47 dist-test-slave-qg60 krb5kdc[32057](info): commencing operation
krb5kdc: starting...
W20260810 03:45:48.899737 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:45:48 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:45:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:45:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:45:49.041836 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38477
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:49.166297 32070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:49.166674 32070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:49.166783 32070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:49.171432 32070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:49.171550 32070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:49.171598 32070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:49.171669 32070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:49.171712 32070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:49.177845 32070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:49.179121 32070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:49.180327 32070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:49.189936 32077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:49.189941 32076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:49.189936 32079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:49.190176 32070 server_base.cc:1034] running on GCE node
I20260810 03:45:49.190946 32070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:49.192312 32070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:49.193524 32070 hybrid_clock.cc:648] HybridClock initialized: now 1786333549193514 us; error 44 us; skew 500 ppm
Aug 10 03:45:49 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:49.196641 32070 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:49.197727 32070 webserver.cc:460] Webserver started at http://127.22.134.254:33053/ using document root <none> and password file <none>
I20260810 03:45:49.198372 32070 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:49.198474 32070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:49.198719 32070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:49.200930 32070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "cae4c0af5d7948a1ae98b4a644a57e2d"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "4e3fc030d4dcf5b0fc047d313c5569e4"
server_key_iv: "51620f157b8fe4992a8758afa87ec126"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.201565 32070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "cae4c0af5d7948a1ae98b4a644a57e2d"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "4e3fc030d4dcf5b0fc047d313c5569e4"
server_key_iv: "51620f157b8fe4992a8758afa87ec126"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.206060 32070 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:49.208920 32087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:49.210376 32070 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:49.210536 32070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "cae4c0af5d7948a1ae98b4a644a57e2d"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "4e3fc030d4dcf5b0fc047d313c5569e4"
server_key_iv: "51620f157b8fe4992a8758afa87ec126"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.210671 32070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:49.231791 32070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:49.235473 32070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:49.235709 32070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:49.243484 32070 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:38477
I20260810 03:45:49.243510 32142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:38477 every 8 connection(s)
I20260810 03:45:49.244501 32070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:49.247427 32143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:45:49.250443 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 32070
I20260810 03:45:49.250622 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:45:49.250965 23067 external_mini_cluster.cc:1428] Setting key 6415ea1afef6df9ad62e571b167f43ce
I20260810 03:45:49.253854 32143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Bootstrap starting.
I20260810 03:45:49.256060 32143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Neither blocks nor log segments found. Creating new log.
I20260810 03:45:49.256920 32143 log.cc:824] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:49.259090 32143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: No bootstrap required, opened a new log
Aug 10 03:45:49 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:49.263175 32143 raft_consensus.cc:348] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } }
I20260810 03:45:49.263491 32143 raft_consensus.cc:374] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:45:49.263586 32143 raft_consensus.cc:729] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cae4c0af5d7948a1ae98b4a644a57e2d, State: Initialized, Role: FOLLOWER
I20260810 03:45:49.264108 32143 consensus_queue.cc:260] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } }
I20260810 03:45:49.264258 32143 raft_consensus.cc:388] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:49.264348 32143 raft_consensus.cc:482] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:49.264444 32143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:45:49.265750 32143 raft_consensus.cc:504] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } }
I20260810 03:45:49.266114 32143 leader_election.cc:302] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cae4c0af5d7948a1ae98b4a644a57e2d; no voters:
I20260810 03:45:49.266443 32143 leader_election.cc:288] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:45:49.266605 32148 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:45:49.266688 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:49.252491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50238 (local address 127.22.134.254:38477)
0810 03:45:49.252962 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:49.252981 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:49.253018 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:45:49.253624 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:49.253640 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:49.254027 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:49.254377 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:49.255204 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.256266 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.257251 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.257941 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.258117 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:49.261098 (+ 2981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:49.261104 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:49.261119 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:49.261148 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:49.262944 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:49.263542 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:49.263556 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:49.263580 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:49.263778 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:49.264120 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:49.264122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:49.264124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:49.264791 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:49.264980 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:49.265283 (+ 303us) server_negotiation.cc:299] Negotiation successful
0810 03:45:49.265665 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":166,"threads_started":1}
I20260810 03:45:49.266849 32148 raft_consensus.cc:686] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 1 LEADER]: Becoming Leader. State: Replica: cae4c0af5d7948a1ae98b4a644a57e2d, State: Running, Role: LEADER
I20260810 03:45:49.267205 32148 consensus_queue.cc:237] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } }
I20260810 03:45:49.267879 32143 sys_catalog.cc:564] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:49.269743 32150 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cae4c0af5d7948a1ae98b4a644a57e2d. Latest consensus state: current_term: 1 leader_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } } }
I20260810 03:45:49.269889 32150 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:49.270223 32149 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } } }
I20260810 03:45:49.270679 32149 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: This master's current role is: LEADER
W20260810 03:45:49.273170 32168 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:45:49.273253 32168 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:45:49.273344 32167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:49.274361 32167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:49.280616 32167 catalog_manager.cc:1347] Generated new cluster ID: 8a7a661277aa41a384ae86e32bb9eb83
I20260810 03:45:49.280707 32167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:49.298224 32167 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:45:49.299229 32167 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:49.309216 32167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Generated new TSK 0
I20260810 03:45:49.310062 32167 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:45:49.348361 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38477
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:49.463256 32175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:49.463527 32175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:49.463573 32175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:49.467684 32175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:49.467751 32175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:49.467809 32175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:49.473341 32175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:49.474380 32175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:49.475459 32175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:49.485587 32182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:49.485580 32180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:49.485742 32175 server_base.cc:1034] running on GCE node
W20260810 03:45:49.485601 32184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:49.486423 32175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:49.487210 32175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:49.488416 32175 hybrid_clock.cc:648] HybridClock initialized: now 1786333549488387 us; error 48 us; skew 500 ppm
Aug 10 03:45:49 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:49.496230 32175 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:45:49.497233 32175 webserver.cc:460] Webserver started at http://127.22.134.193:38805/ using document root <none> and password file <none>
I20260810 03:45:49.497777 32175 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:49.497838 32175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:49.498013 32175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:49.500072 32175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "ec8d0dcc6c2a44cb8af2bc5d552a2fe0"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "2abbd4fde1b30c8307f712f5ed243fe0"
server_key_iv: "fed62a9e970fd29ba66f24f91eb4c46e"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.500607 32175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "ec8d0dcc6c2a44cb8af2bc5d552a2fe0"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "2abbd4fde1b30c8307f712f5ed243fe0"
server_key_iv: "fed62a9e970fd29ba66f24f91eb4c46e"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.504504 32175 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 03:45:49.507105 32192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:49.508364 32175 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:49.508520 32175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "ec8d0dcc6c2a44cb8af2bc5d552a2fe0"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "2abbd4fde1b30c8307f712f5ed243fe0"
server_key_iv: "fed62a9e970fd29ba66f24f91eb4c46e"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.508648 32175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:49.521212 32175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:49.524283 32175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:49.524492 32175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:49.525170 32175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:49.526032 32175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:49.526081 32175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:49.526124 32175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:49.526185 32175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:49.536293 32175 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:35575
I20260810 03:45:49.536314 32317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:35575 every 8 connection(s)
I20260810 03:45:49.537300 32175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:49.546113 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 32175
I20260810 03:45:49.546276 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:45:49.546617 23067 external_mini_cluster.cc:1428] Setting key 0091fed7cb9926a92ddd38dfc70e15ca
Aug 10 03:45:49 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:49.552299 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:49.539350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:60057 (local address 127.22.134.254:38477)
0810 03:45:49.539526 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:49.539530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:49.540405 (+ 875us) server_negotiation.cc:407] Connection header received
0810 03:45:49.541791 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:49.541794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:49.541866 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:49.541953 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:49.543182 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.543806 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.545197 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.545429 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.545528 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:49.548429 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:49.548432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:49.548435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:49.548459 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:49.550077 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:49.550655 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:49.550659 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:49.550661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:49.550748 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:49.551116 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:49.551120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:49.551122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:49.551322 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:49.551437 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:49.551985 (+ 548us) server_negotiation.cc:299] Negotiation successful
0810 03:45:49.552127 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 03:45:49.553249 32320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:49.539739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:60057)
0810 03:45:49.540236 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:49.540283 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:49.541541 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:49.542125 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:49.542131 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:49.542501 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:49.543019 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:49.543032 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.543962 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.543966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:49.545020 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:49.545031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.545605 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.545608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:49.545751 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:49.546471 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:49.546488 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:49.548246 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:49.550222 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:49.550229 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:49.550246 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:49.550538 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:49.550848 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:49.550852 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:49.550854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:49.551016 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:49.551435 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:49.551443 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:49.551727 (+ 284us) client_negotiation.cc:769] Sending connection context
0810 03:45:49.551932 (+ 205us) client_negotiation.cc:240] Negotiation successful
0810 03:45:49.552285 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":129,"threads_started":1}
I20260810 03:45:49.554768 32318 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38477
I20260810 03:45:49.555050 32318 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:49.555794 32318 heartbeater.cc:511] Master 127.22.134.254:38477 requested a full tablet report, sending...
I20260810 03:45:49.557935 32105 ts_manager.cc:194] Registered new tserver with Master: ec8d0dcc6c2a44cb8af2bc5d552a2fe0 (127.22.134.193:35575)
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:45:49.559949 32105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:60057
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:45:49.584007 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38477
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:49.707202 32325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:49.707515 32325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:49.707561 32325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:49.712182 32325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:49.712262 32325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:49.712327 32325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:49.718104 32325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:49.719182 32325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:49.720168 32325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:49.730319 32333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:49.730381 32330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:49.730401 32325 server_base.cc:1034] running on GCE node
W20260810 03:45:49.730345 32331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:49.730983 32325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:49.731726 32325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:49.732884 32325 hybrid_clock.cc:648] HybridClock initialized: now 1786333549732863 us; error 35 us; skew 500 ppm
Aug 10 03:45:49 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:49.736174 32325 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:45:49.737320 32325 webserver.cc:460] Webserver started at http://127.22.134.194:33755/ using document root <none> and password file <none>
I20260810 03:45:49.737953 32325 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:49.738097 32325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:49.738355 32325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:49.740605 32325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "6705c673686441fd9b32bcdab4a563e2"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "57606a41989567a09df927eec3e5b869"
server_key_iv: "0882e03d2887131093ace7c88b7a81ed"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.741302 32325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "6705c673686441fd9b32bcdab4a563e2"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "57606a41989567a09df927eec3e5b869"
server_key_iv: "0882e03d2887131093ace7c88b7a81ed"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.745754 32325 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:49.748689 32340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:49.750325 32325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:49.750500 32325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "6705c673686441fd9b32bcdab4a563e2"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "57606a41989567a09df927eec3e5b869"
server_key_iv: "0882e03d2887131093ace7c88b7a81ed"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.750613 32325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:49.779639 32325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:49.783429 32325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:49.783663 32325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:49.784302 32325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:49.785238 32325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:49.785310 32325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:49.785377 32325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:49.785429 32325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:49.794667 32325 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:38995
I20260810 03:45:49.794709 32467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:38995 every 8 connection(s)
I20260810 03:45:49.795629 32325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:49.802977 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 32325
I20260810 03:45:49.803140 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:45:49.803494 23067 external_mini_cluster.cc:1428] Setting key 7d4a406bb2bf4d8ab7d30dc4e9cf9243
Aug 10 03:45:49 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:49.811432 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:49.797626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:54767 (local address 127.22.134.254:38477)
0810 03:45:49.797806 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:49.797809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:49.798887 (+ 1078us) server_negotiation.cc:407] Connection header received
0810 03:45:49.799814 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:49.799818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:49.799878 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:49.799968 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:49.801267 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.801849 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.803023 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.803351 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.803465 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:49.806901 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:49.806904 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:49.806906 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:49.806929 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:49.808820 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:49.809531 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:49.809535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:49.809537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:49.809663 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:49.810034 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:49.810040 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:49.810045 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:49.810344 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:49.810468 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:49.811034 (+ 566us) server_negotiation.cc:299] Negotiation successful
0810 03:45:49.811179 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260810 03:45:49.812345 32470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:49.798006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:54767)
0810 03:45:49.798729 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:49.798770 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:49.799597 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:49.800189 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:49.800196 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:49.800559 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:49.801113 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:49.801127 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.801984 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.801988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:49.802887 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:49.802897 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:49.803510 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:49.803514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:49.803714 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:49.804439 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:49.804460 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:49.806708 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:49.808978 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:49.808985 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:49.809010 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:49.809390 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:49.809783 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:49.809785 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:49.809786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:49.809928 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:49.810460 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:49.810466 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:49.810792 (+ 326us) client_negotiation.cc:769] Sending connection context
0810 03:45:49.810958 (+ 166us) client_negotiation.cc:240] Negotiation successful
0810 03:45:49.811286 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":146,"threads_started":1}
I20260810 03:45:49.813766 32468 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38477
I20260810 03:45:49.814043 32468 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:49.814739 32468 heartbeater.cc:511] Master 127.22.134.254:38477 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:45:49.815943 32105 ts_manager.cc:194] Registered new tserver with Master: 6705c673686441fd9b32bcdab4a563e2 (127.22.134.194:38995)
I20260810 03:45:49.816566 32105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:54767
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:45:49.836717 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38477
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:49.953877 32473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:49.954224 32473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:49.954334 32473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:49.958696 32473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:49.958812 32473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:49.958918 32473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:49.964654 32473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:49.965946 32473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:49.967067 32473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:49.978259 32480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:49.978147 32482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:49.978142 32479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:49.978705 32473 server_base.cc:1034] running on GCE node
I20260810 03:45:49.979179 32473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:49.979903 32473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:49.981135 32473 hybrid_clock.cc:648] HybridClock initialized: now 1786333549981114 us; error 32 us; skew 500 ppm
Aug 10 03:45:49 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:49.984310 32473 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:45:49.985430 32473 webserver.cc:460] Webserver started at http://127.22.134.195:37983/ using document root <none> and password file <none>
I20260810 03:45:49.986023 32473 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:49.986091 32473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:49.986274 32473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:45:49.988755 32473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "ede6347a3c6542abb39e3be63364cd70"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "710fc945b50a8ede1365de16e3f066e7"
server_key_iv: "e006effe9f05de76e7042f33cba192e6"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.989382 32473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "ede6347a3c6542abb39e3be63364cd70"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "710fc945b50a8ede1365de16e3f066e7"
server_key_iv: "e006effe9f05de76e7042f33cba192e6"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.993397 32473 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:45:49.995999 32489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:49.997500 32473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:49.997658 32473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "ede6347a3c6542abb39e3be63364cd70"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "710fc945b50a8ede1365de16e3f066e7"
server_key_iv: "e006effe9f05de76e7042f33cba192e6"
server_key_version: "encryptionkey@0"
I20260810 03:45:49.997781 32473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:50.030156 32473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:50.033987 32473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:50.034241 32473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:50.034920 32473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:50.035890 32473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:50.035967 32473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.036051 32473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:50.036098 32473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.046439 32473 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:39463
I20260810 03:45:50.046530 32610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:39463 every 8 connection(s)
I20260810 03:45:50.047508 32473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:50.055699 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 32473
I20260810 03:45:50.055877 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:45:50.056201 23067 external_mini_cluster.cc:1428] Setting key 5b25e36f9f20a4f4394ff43cc9da4ccd
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:45:50.063925 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:50.049830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:59253 (local address 127.22.134.254:38477)
0810 03:45:50.050058 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:50.050062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:50.051268 (+ 1206us) server_negotiation.cc:407] Connection header received
0810 03:45:50.052169 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:50.052172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:50.052226 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:50.052319 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:50.053808 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.054514 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.056288 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.056609 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.056712 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.059944 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:50.059948 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:50.059950 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:50.059980 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:50.061619 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:50.062216 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:50.062220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:50.062221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:50.062316 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:50.062742 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:50.062745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:50.062746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:50.062960 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:50.063073 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:50.063656 (+ 583us) server_negotiation.cc:299] Negotiation successful
0810 03:45:50.063793 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260810 03:45:50.064985 32614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:50.050300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:59253)
0810 03:45:50.051075 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:50.051132 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:50.051940 (+ 808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:50.052524 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:50.052531 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:50.053056 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:50.053611 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.053626 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.054680 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.054683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.056095 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.056107 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.056821 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.056827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.057033 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.057824 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:50.057849 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:50.059735 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:45:50.061755 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:50.061761 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:50.061778 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:50.062083 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:50.062427 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:45:50.062429 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:45:50.062431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:45:50.062592 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:45:50.063079 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:45:50.063086 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:45:50.063377 (+ 291us) client_negotiation.cc:769] Sending connection context
0810 03:45:50.063554 (+ 177us) client_negotiation.cc:240] Negotiation successful
0810 03:45:50.063879 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":140,"threads_started":1}
I20260810 03:45:50.066435 32612 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38477
I20260810 03:45:50.066754 32612 heartbeater.cc:464] Registering TS with master...
I20260810 03:45:50.067317 32612 heartbeater.cc:511] Master 127.22.134.254:38477 requested a full tablet report, sending...
I20260810 03:45:50.068480 32105 ts_manager.cc:194] Registered new tserver with Master: ede6347a3c6542abb39e3be63364cd70 (127.22.134.195:39463)
I20260810 03:45:50.069339 32105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:59253
I20260810 03:45:50.070896 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab.
Entry for principal oryx/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab.
WARNING: no policy specified for oryx/127.22.134.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab.
Entry for principal oryx/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab.
WARNING: no policy specified for oryx/127.22.134.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab.
Entry for principal oryx/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab.
I20260810 03:45:50.165184 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 32175
I20260810 03:45:50.173539 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 32325
I20260810 03:45:50.182497 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 32473
I20260810 03:45:50.190650 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 32070
I20260810 03:45:50.201086 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38477
--webserver_interface=127.22.134.254
--webserver_port=33053
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:45:50.318341 32622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:50.318636 32622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:50.318678 32622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:50.323380 32622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:45:50.323455 32622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:50.323477 32622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:50.323493 32622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:45:50.323508 32622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:45:50.329094 32622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=33053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:50.330163 32622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:50.331157 32622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:45:50.340579 32622 server_base.cc:1034] running on GCE node
W20260810 03:45:50.340579 32628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:50.340631 32627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:50.340884 32630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:50.341423 32622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:50.342645 32622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:50.343856 32622 hybrid_clock.cc:648] HybridClock initialized: now 1786333550343839 us; error 31 us; skew 500 ppm
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333550, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:50.346779 32622 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:45:50.347725 32622 webserver.cc:460] Webserver started at http://127.22.134.254:33053/ using document root <none> and password file <none>
I20260810 03:45:50.348304 32622 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:50.348417 32622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:50.352481 32622 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:50.354838 32638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.356163 32622 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:45:50.356321 32622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "cae4c0af5d7948a1ae98b4a644a57e2d"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "4e3fc030d4dcf5b0fc047d313c5569e4"
server_key_iv: "51620f157b8fe4992a8758afa87ec126"
server_key_version: "encryptionkey@0"
I20260810 03:45:50.356995 32622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:50.370090 32622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:50.373447 32622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:50.373682 32622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:50.381842 32622 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:38477
I20260810 03:45:50.381855 32693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:38477 every 8 connection(s)
I20260810 03:45:50.383075 32622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:45:50.387568 32694 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:45:50.388703 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 32622
I20260810 03:45:50.389312 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:35575
--local_ip_for_outbound_sockets=127.22.134.193
--tserver_master_addrs=127.22.134.254:38477
--webserver_port=38805
--webserver_interface=127.22.134.193
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.134.193
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:45:50.389560 32694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Bootstrap starting.
I20260810 03:45:50.413555 32694 log.cc:824] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:45:50.423036 32694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:45:50.423538 32694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Bootstrap complete.
I20260810 03:45:50.429989 32694 raft_consensus.cc:348] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } }
I20260810 03:45:50.430593 32694 raft_consensus.cc:729] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cae4c0af5d7948a1ae98b4a644a57e2d, State: Initialized, Role: FOLLOWER
I20260810 03:45:50.431253 32694 consensus_queue.cc:260] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } }
I20260810 03:45:50.431419 32694 raft_consensus.cc:388] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:45:50.431497 32694 raft_consensus.cc:482] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:45:50.431613 32694 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:45:50.434553 32694 raft_consensus.cc:504] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } }
I20260810 03:45:50.434971 32694 leader_election.cc:302] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cae4c0af5d7948a1ae98b4a644a57e2d; no voters:
I20260810 03:45:50.435385 32694 leader_election.cc:288] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 03:45:50.435627 32699 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:45:50.435909 32699 raft_consensus.cc:686] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [term 2 LEADER]: Becoming Leader. State: Replica: cae4c0af5d7948a1ae98b4a644a57e2d, State: Running, Role: LEADER
I20260810 03:45:50.436234 32699 consensus_queue.cc:237] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } }
I20260810 03:45:50.436975 32694 sys_catalog.cc:564] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:45:50.437948 32702 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cae4c0af5d7948a1ae98b4a644a57e2d. Latest consensus state: current_term: 2 leader_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } } }
I20260810 03:45:50.437922 32701 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cae4c0af5d7948a1ae98b4a644a57e2d" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38477 } } }
I20260810 03:45:50.438076 32702 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:50.438092 32701 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d [sys.catalog]: This master's current role is: LEADER
I20260810 03:45:50.438490 32714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:45:50.442237 32714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:45:50.442978 32714 catalog_manager.cc:1259] Loaded cluster ID: 8a7a661277aa41a384ae86e32bb9eb83
I20260810 03:45:50.443043 32714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:45:50.445511 32714 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:45:50.446223 32714 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cae4c0af5d7948a1ae98b4a644a57e2d: Loaded TSK: 0
I20260810 03:45:50.447491 32714 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:45:50.531368 32697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:50.531641 32697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:50.531687 32697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:50.535910 32697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:50.535982 32697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:50.536082 32697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:45:50.542491 32697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.193.keytab
--principal=oryx/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:35575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=38805
--tserver_master_addrs=127.22.134.254:38477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:50.543594 32697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:50.544634 32697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:50.555801 32728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:50.555858 32697 server_base.cc:1034] running on GCE node
W20260810 03:45:50.555801 32729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:50.556208 32732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:50.556656 32697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:50.557498 32697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:50.558717 32697 hybrid_clock.cc:648] HybridClock initialized: now 1786333550558691 us; error 47 us; skew 500 ppm
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333550, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:50.562235 32697 init.cc:377] Logged in from keytab as oryx/127.22.134.193@KRBTEST.COM (short username oryx)
I20260810 03:45:50.563354 32697 webserver.cc:460] Webserver started at http://127.22.134.193:38805/ using document root <none> and password file <none>
I20260810 03:45:50.563958 32697 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:50.564072 32697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:50.568480 32697 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:50.571621 32739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.573076 32697 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:45:50.573223 32697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "ec8d0dcc6c2a44cb8af2bc5d552a2fe0"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "2abbd4fde1b30c8307f712f5ed243fe0"
server_key_iv: "fed62a9e970fd29ba66f24f91eb4c46e"
server_key_version: "encryptionkey@0"
I20260810 03:45:50.573818 32697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:50.595373 32697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:50.598898 32697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:50.599120 32697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:50.599787 32697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:50.600703 32697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:50.600845 32697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.600921 32697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:50.600972 32697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.610802 32697 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:35575
I20260810 03:45:50.610838 395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:35575 every 8 connection(s)
I20260810 03:45:50.611955 32697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:45:50.618806 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 32697
I20260810 03:45:50.619338 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:38995
--local_ip_for_outbound_sockets=127.22.134.194
--tserver_master_addrs=127.22.134.254:38477
--webserver_port=33755
--webserver_interface=127.22.134.194
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.134.194
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:50.626891 399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:50.614229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:44597)
0810 03:45:50.614714 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:50.614769 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:50.616054 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:50.617283 (+ 1229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:50.617289 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:50.617650 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:50.618086 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.618101 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.619943 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.619946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.620893 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.620902 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.622075 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.622083 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.622388 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.623047 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:50.623073 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:50.625888 (+ 2815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":143,"threads_started":1}
W20260810 03:45:50.626881 398 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:50.614105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:44597 (local address 127.22.134.254:38477)
0810 03:45:50.614575 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:50.614591 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:50.614892 (+ 301us) server_negotiation.cc:407] Connection header received
0810 03:45:50.616446 (+ 1554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:50.616458 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:50.616829 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:50.617197 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:50.618256 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.619801 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.621070 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.621838 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.622031 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.626107 (+ 4076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:44597: BlockingRecv error: recv got EOF from 127.22.134.193:44597 (error 108)
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":138,"threads_started":1}
W20260810 03:45:50.627358 396 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:38477 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.134.254:38477: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:50.633312 399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:50.627805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:54335)
0810 03:45:50.628063 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:50.628076 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:50.628192 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:50.628452 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:50.628455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:50.628627 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:50.628718 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.628787 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.629545 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.629550 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.630111 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.630119 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.630600 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.630604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.630705 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.631220 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:50.631232 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:50.633160 (+ 1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":130}
W20260810 03:45:50.633433 398 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:50.627901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:54335 (local address 127.22.134.254:38477)
0810 03:45:50.628016 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:50.628021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:50.628142 (+ 121us) server_negotiation.cc:407] Connection header received
0810 03:45:50.628293 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:50.628296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:50.628349 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:50.628436 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:50.628898 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.629431 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.630236 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.630468 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.630577 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.633298 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:54335: BlockingRecv error: recv got EOF from 127.22.134.193:54335 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:50.639519 399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:50.633933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:47019)
0810 03:45:50.634104 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:50.634119 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:50.634189 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:50.634419 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:50.634422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:50.634599 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:50.634693 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.634698 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.635414 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.635417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.636287 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.636296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.636831 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.636835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.636923 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.637375 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:50.637389 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:50.639369 (+ 1980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106}
W20260810 03:45:50.639592 398 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:50.634027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:47019 (local address 127.22.134.254:38477)
0810 03:45:50.634181 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:50.634184 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:50.634197 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:45:50.634268 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:50.634270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:50.634308 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:50.634373 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:50.634806 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.635311 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.636404 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.636679 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.636827 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.639482 (+ 2655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:47019: BlockingRecv error: recv got EOF from 127.22.134.193:47019 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 03:45:50.639863 396 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:45:50.738857 401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:50.739329 401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:50.739418 401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:50.744978 401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:50.745095 401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:50.745203 401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:45:50.753521 401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.194.keytab
--principal=oryx/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:38995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=33755
--tserver_master_addrs=127.22.134.254:38477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:50.755107 401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:50.756453 401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:50.766784 406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:50.766898 401 server_base.cc:1034] running on GCE node
W20260810 03:45:50.766784 408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:50.766796 410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:50.767486 401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:50.768196 401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:50.769413 401 hybrid_clock.cc:648] HybridClock initialized: now 1786333550769392 us; error 30 us; skew 500 ppm
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333550, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:50.772460 401 init.cc:377] Logged in from keytab as oryx/127.22.134.194@KRBTEST.COM (short username oryx)
I20260810 03:45:50.773519 401 webserver.cc:460] Webserver started at http://127.22.134.194:33755/ using document root <none> and password file <none>
I20260810 03:45:50.774127 401 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:50.774246 401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:50.778450 401 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 03:45:50.780802 418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.782109 401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:45:50.782248 401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "6705c673686441fd9b32bcdab4a563e2"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "57606a41989567a09df927eec3e5b869"
server_key_iv: "0882e03d2887131093ace7c88b7a81ed"
server_key_version: "encryptionkey@0"
I20260810 03:45:50.782814 401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:50.803154 401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:50.806447 401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:50.806677 401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:50.807296 401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:50.808156 401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:50.808230 401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.808302 401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:50.808354 401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.818523 401 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:38995
I20260810 03:45:50.818564 540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:38995 every 8 connection(s)
I20260810 03:45:50.819568 401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:45:50.824254 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 401
I20260810 03:45:50.824860 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:39463
--local_ip_for_outbound_sockets=127.22.134.195
--tserver_master_addrs=127.22.134.254:38477
--webserver_port=37983
--webserver_interface=127.22.134.195
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.134.195
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:45:50.833120 398 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:50.821657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:60213 (local address 127.22.134.254:38477)
0810 03:45:50.821814 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:50.821818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:50.822647 (+ 829us) server_negotiation.cc:407] Connection header received
0810 03:45:50.824264 (+ 1617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:50.824267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:50.824361 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:50.824479 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:50.826131 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.826745 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.828100 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.828466 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.828629 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.832977 (+ 4348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:60213: BlockingRecv error: recv got EOF from 127.22.134.194:60213 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:45:50.833854 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:50.821949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:60213)
0810 03:45:50.822450 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:50.822497 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:50.823969 (+ 1472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:50.824844 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:50.824852 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:50.825401 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:50.825949 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.825964 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.826908 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.826912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.827920 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.827931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.828680 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.828684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.828927 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.829670 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:50.829688 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:50.832831 (+ 3143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":120,"threads_started":1}
W20260810 03:45:50.834529 541 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:38477 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.134.254:38477: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:50.841961 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:50.835099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:59823)
0810 03:45:50.835366 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:50.835381 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:50.835457 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:50.835824 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:50.835827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:50.835983 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:50.836088 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.836093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.837441 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.837444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.838074 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.838085 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.838800 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.838803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.838890 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.839556 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:50.839569 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:50.841850 (+ 2281us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197}
W20260810 03:45:50.842186 398 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:50.835247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:59823 (local address 127.22.134.254:38477)
0810 03:45:50.835403 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:50.835411 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:50.835434 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:45:50.835577 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:50.835583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:50.835660 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:50.835774 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:50.836231 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.837315 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.838206 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.838646 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.838760 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.842048 (+ 3288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:59823: BlockingRecv error: recv got EOF from 127.22.134.194:59823 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:45:50.849164 398 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:50.842810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:35837 (local address 127.22.134.254:38477)
0810 03:45:50.842934 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:50.842939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:50.842955 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:45:50.843027 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:50.843031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:50.843076 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:50.843168 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:50.843504 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.844401 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.845409 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.845904 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.846032 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.849015 (+ 2983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:35837: BlockingRecv error: recv got EOF from 127.22.134.194:35837 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:45:50.849195 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:50.842729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:35837)
0810 03:45:50.842845 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:50.842862 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:50.842947 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:50.843189 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:50.843191 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:50.843321 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:50.843397 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.843401 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.844556 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.844559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.845244 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:50.845254 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:50.846062 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:50.846065 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:50.846132 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:50.846716 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:50.846728 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:50.848833 (+ 2105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 03:45:50.849675 541 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:45:50.947046 544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:45:50.947414 544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:45:50.947461 544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:45:50.951802 544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:45:50.951884 544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:45:50.951949 544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:45:50.957806 544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/krb5kdc/oryx_127.22.134.195.keytab
--principal=oryx/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:39463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=37983
--tserver_master_addrs=127.22.134.254:38477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:45:50.958956 544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:45:50.959997 544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:45:50.970254 550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:50.970296 553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:45:50.970296 551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:45:50.970839 544 server_base.cc:1034] running on GCE node
I20260810 03:45:50.971367 544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:45:50.971982 544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:45:50.973170 544 hybrid_clock.cc:648] HybridClock initialized: now 1786333550973150 us; error 30 us; skew 500 ppm
Aug 10 03:45:50 dist-test-slave-qg60 krb5kdc[32057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333550, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:45:50.976079 544 init.cc:377] Logged in from keytab as oryx/127.22.134.195@KRBTEST.COM (short username oryx)
I20260810 03:45:50.977090 544 webserver.cc:460] Webserver started at http://127.22.134.195:37983/ using document root <none> and password file <none>
I20260810 03:45:50.977747 544 fs_manager.cc:359] Metadata directory not provided
I20260810 03:45:50.977862 544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:45:50.982079 544 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:45:50.984278 560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:50.985621 544 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:45:50.985765 544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "ede6347a3c6542abb39e3be63364cd70"
format_stamp: "Formatted at 2026-08-10 03:45:49 on dist-test-slave-qg60"
server_key: "710fc945b50a8ede1365de16e3f066e7"
server_key_iv: "e006effe9f05de76e7042f33cba192e6"
server_key_version: "encryptionkey@0"
I20260810 03:45:50.986423 544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:45:51.004134 544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:45:51.007596 544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:45:51.007839 544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:45:51.008492 544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:45:51.009475 544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:45:51.009554 544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:51.009634 544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:45:51.009686 544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:45:51.019251 544 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:39463
I20260810 03:45:51.019269 685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:39463 every 8 connection(s)
I20260810 03:45:51.020375 544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:45:51.023254 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 544
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 03:45:51.034286 398 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:51.022439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:42579 (local address 127.22.134.254:38477)
0810 03:45:51.022631 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:51.022636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:51.023616 (+ 980us) server_negotiation.cc:407] Connection header received
0810 03:45:51.025356 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:51.025362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:51.025412 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:51.025502 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:51.026763 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.027506 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.029220 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.029579 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.029692 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.034151 (+ 4459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:42579: BlockingRecv error: recv got EOF from 127.22.134.195:42579 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 03:45:51.035151 688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:51.022859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:42579)
0810 03:45:51.023410 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:51.023474 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:51.025130 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:51.025714 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:51.025723 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:51.026082 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:51.026614 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.026628 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.027677 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.027680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.029060 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.029072 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.029786 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.029791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.030023 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.030790 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:51.030812 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:51.034021 (+ 3209us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":122,"threads_started":1}
I20260810 03:45:51.035487 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:51.024372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50244 (local address 127.22.134.254:38477)
0810 03:45:51.024638 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:51.024642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:51.024653 (+ 11us) server_negotiation.cc:407] Connection header received
0810 03:45:51.024694 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:51.024697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:51.024756 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:51.024864 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:51.025728 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.026270 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.027448 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.027775 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.027893 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.029789 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:45:51.029797 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:45:51.029818 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:45:51.029856 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:45:51.032770 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:51.033383 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:51.033391 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:51.033399 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:51.033555 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:45:51.033886 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:45:51.033889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:45:51.033891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:45:51.034318 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:45:51.034569 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0810 03:45:51.034998 (+ 429us) server_negotiation.cc:299] Negotiation successful
0810 03:45:51.035324 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":81,"threads_started":1}
W20260810 03:45:51.035696 686 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:38477 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.134.254:38477: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:51.042236 688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:51.036162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:39607)
0810 03:45:51.036266 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:51.036283 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:51.036361 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:51.036680 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:51.036683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:51.036895 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:51.037019 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.037026 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.038024 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.038027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.038754 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.038765 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.039426 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.039429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.039530 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.040171 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:51.040184 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:51.042122 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 03:45:51.042461 690 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:51.036228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:39607 (local address 127.22.134.254:38477)
0810 03:45:51.036336 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:51.036340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:51.036354 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:45:51.036445 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:51.036450 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:51.036510 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:51.036593 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:51.037144 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.037838 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.038922 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.039289 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.039376 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.042334 (+ 2958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:39607: BlockingRecv error: recv got EOF from 127.22.134.195:39607 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:51.047935 688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:51.042817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:43451)
0810 03:45:51.042966 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:51.042979 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:51.043086 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:51.043366 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:51.043369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:51.043535 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:51.043609 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.043615 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.044352 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.044355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.044938 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.044947 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.045397 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.045400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.045480 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.045936 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:51.045948 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:51.047777 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76}
W20260810 03:45:51.048002 690 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:51.042926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:43451 (local address 127.22.134.254:38477)
0810 03:45:51.043101 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:51.043105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:51.043121 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:45:51.043210 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:51.043212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:51.043261 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:51.043349 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:51.043732 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.044240 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.045059 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.045281 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.045394 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.047894 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:43451: BlockingRecv error: recv got EOF from 127.22.134.195:43451 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
W20260810 03:45:51.048262 686 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:51.646576 691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:51.640558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:57665)
0810 03:45:51.640862 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:51.640878 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:51.640971 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:51.641275 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:51.641277 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:51.641457 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:51.641576 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.641582 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.642419 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.642421 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.643001 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.643008 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.643470 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.643472 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.643540 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.644064 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:51.644076 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:51.646440 (+ 2364us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":92,"threads_started":1}
W20260810 03:45:51.646783 692 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:51.640644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:57665 (local address 127.22.134.254:38477)
0810 03:45:51.640926 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:51.640930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:51.640946 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:45:51.641100 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:51.641103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:51.641151 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:51.641242 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:51.641683 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.642316 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.643129 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.643370 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.643452 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.646597 (+ 3145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:57665: BlockingRecv error: recv got EOF from 127.22.134.193:57665 (error 108)
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":127,"threads_started":1}
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:51 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:51.856040 693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:51.850433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:52467)
0810 03:45:51.850695 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:51.850709 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:51.850807 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:51.851087 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:51.851090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:51.851280 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:51.851380 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.851385 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.852130 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.852133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.852773 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:51.852783 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.853285 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.853289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:51.853358 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.853893 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:51.853905 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:51.855905 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":92,"threads_started":1}
W20260810 03:45:51.856182 692 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:51.850495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:52467 (local address 127.22.134.254:38477)
0810 03:45:51.850676 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:51.850680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:51.850781 (+ 101us) server_negotiation.cc:407] Connection header received
0810 03:45:51.850888 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:51.850890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:51.850934 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:51.851009 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:51.851491 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.852021 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.852883 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:51.853148 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:51.853236 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:51.856052 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:52467: BlockingRecv error: recv got EOF from 127.22.134.194:52467 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 10 03:45:52 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:52 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:52.055022 696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:52.049044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:44457)
0810 03:45:52.049341 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:52.049357 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:52.049463 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:52.049723 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:52.049725 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:52.049911 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:52.050010 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:52.050015 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.050807 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.050811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:52.051429 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:52.051438 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.051877 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.051879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:52.051941 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:52.052507 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:52.052519 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:52.054896 (+ 2377us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":115,"threads_started":1}
W20260810 03:45:52.055156 692 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:52.049151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:44457 (local address 127.22.134.254:38477)
0810 03:45:52.049293 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:52.049297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:52.049447 (+ 150us) server_negotiation.cc:407] Connection header received
0810 03:45:52.049536 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:52.049539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:52.049586 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:52.049683 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:52.050130 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.050692 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.051540 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.051772 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.051853 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:52.055036 (+ 3183us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:44457: BlockingRecv error: recv got EOF from 127.22.134.195:44457 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 03:45:52 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:52 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:52.654013 697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:52.647420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:43891)
0810 03:45:52.647736 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:52.647751 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:52.647840 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:52.648246 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:52.648268 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:52.648476 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:52.648581 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:52.648587 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.649573 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.649576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:52.650165 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:52.650175 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.650763 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.650767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:52.650874 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:52.651689 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:52.651703 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:52.653867 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":104,"threads_started":1}
W20260810 03:45:52.654230 698 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:52.647605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:43891 (local address 127.22.134.254:38477)
0810 03:45:52.647878 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:52.647882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:52.647902 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:45:52.647949 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:52.647952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:52.648061 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:52.648162 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:52.648757 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.649428 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.650313 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.650581 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.650752 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:52.654043 (+ 3291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:43891: BlockingRecv error: recv got EOF from 127.22.134.193:43891 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":122,"threads_started":1}
Aug 10 03:45:52 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:52 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:52.862404 699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:52.856873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:40947)
0810 03:45:52.857150 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:52.857165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:52.857271 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:52.857585 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:52.857587 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:52.857782 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:52.857880 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:52.857886 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.858629 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.858632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:52.859190 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:52.859198 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.859618 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.859622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:52.859685 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:52.860273 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:52.860285 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:52.862261 (+ 1976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":93,"threads_started":1}
W20260810 03:45:52.862578 698 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:52.856940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:40947 (local address 127.22.134.254:38477)
0810 03:45:52.857096 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:52.857102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:52.857239 (+ 137us) server_negotiation.cc:407] Connection header received
0810 03:45:52.857350 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:52.857352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:52.857400 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:52.857470 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:52.857986 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.858510 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.859297 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:52.859511 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:52.859591 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:52.862413 (+ 2822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:40947: BlockingRecv error: recv got EOF from 127.22.134.194:40947 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 03:45:53 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:53 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:53.062342 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:53.055898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:51163)
0810 03:45:53.056283 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:53.056300 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:53.056427 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:53.056799 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:53.056803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:53.057041 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:53.057148 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:53.057154 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.057965 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.057971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:53.058536 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:53.058544 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.059011 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.059015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:53.059105 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:53.059757 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:53.059780 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:53.062197 (+ 2417us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":146,"threads_started":1}
W20260810 03:45:53.062466 698 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:53.056107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:51163 (local address 127.22.134.254:38477)
0810 03:45:53.056284 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:53.056290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:53.056365 (+ 75us) server_negotiation.cc:407] Connection header received
0810 03:45:53.056597 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:53.056600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:53.056648 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:53.056769 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:53.057273 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.057850 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.058665 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.058893 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.059012 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:53.062345 (+ 3333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:51163: BlockingRecv error: recv got EOF from 127.22.134.195:51163 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 10 03:45:53 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:53 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:53.660933 703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:53.654869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:48681)
0810 03:45:53.655202 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:53.655218 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:53.655315 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:53.655572 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:53.655574 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:53.655762 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:53.655866 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:53.655871 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.656631 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.656634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:53.657275 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:53.657285 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.657813 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.657816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:53.657887 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:53.658456 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:53.658469 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:53.660786 (+ 2317us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":141,"threads_started":1}
W20260810 03:45:53.661098 704 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:53.654992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:48681 (local address 127.22.134.254:38477)
0810 03:45:53.655294 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:53.655298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:53.655313 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:45:53.655394 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:53.655396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:53.655439 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:53.655524 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:53.655973 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.656521 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.657421 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.657667 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.657757 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:53.660928 (+ 3171us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:48681: BlockingRecv error: recv got EOF from 127.22.134.193:48681 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":150,"threads_started":1}
Aug 10 03:45:53 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:53 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:53.869993 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:53.863384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:59073)
0810 03:45:53.863719 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:53.863740 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:53.863876 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:53.864222 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:53.864225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:53.864443 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:53.864533 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:53.864538 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.865489 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.865495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:53.866065 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:53.866073 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.866548 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.866551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:53.866647 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:53.867262 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:53.867275 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:53.869871 (+ 2596us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":118,"threads_started":1}
W20260810 03:45:53.870249 704 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:53.863452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:59073 (local address 127.22.134.254:38477)
0810 03:45:53.863669 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:53.863674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:53.863816 (+ 142us) server_negotiation.cc:407] Connection header received
0810 03:45:53.863988 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:53.863991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:53.864046 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:53.864193 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:53.864691 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.865374 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.866193 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:53.866425 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:53.866538 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:53.870003 (+ 3465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:59073: BlockingRecv error: recv got EOF from 127.22.134.194:59073 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 10 03:45:54 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:54 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:54.069473 706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:54.063399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:55271)
0810 03:45:54.063696 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:54.063717 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:54.063859 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:54.064243 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:54.064246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:54.064508 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:54.064646 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:54.064654 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.065601 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.065604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:54.066174 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:54.066182 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.066667 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.066670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:54.066743 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:54.067328 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:54.067340 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:54.069350 (+ 2010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":115,"threads_started":1}
W20260810 03:45:54.069628 704 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:54.063488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:55271 (local address 127.22.134.254:38477)
0810 03:45:54.063645 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:54.063649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:54.063844 (+ 195us) server_negotiation.cc:407] Connection header received
0810 03:45:54.063956 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:54.063958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:54.064048 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:54.064204 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:54.064807 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.065456 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.066293 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.066507 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.066590 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:54.069502 (+ 2912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:55271: BlockingRecv error: recv got EOF from 127.22.134.195:55271 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 03:45:54 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:54 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:54.672103 707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:54.661832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:35909)
0810 03:45:54.662111 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:54.662125 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:54.662217 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:54.662464 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:54.662466 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:54.662652 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:54.662747 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:54.662751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.663518 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.663521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:54.664161 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:54.664177 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.664661 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.664664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:54.664801 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:54.669923 (+ 5122us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:54.669944 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:54.671923 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":98,"threads_started":1}
W20260810 03:45:54.672212 708 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:54.661878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:35909 (local address 127.22.134.254:38477)
0810 03:45:54.662149 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:54.662152 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:54.662173 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:45:54.662310 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:54.662313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:54.662360 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:54.662453 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:54.662849 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.663403 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.664305 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.664528 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.664605 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:54.672068 (+ 7463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:35909: BlockingRecv error: recv got EOF from 127.22.134.193:35909 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":97,"threads_started":1}
Aug 10 03:45:54 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:54 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:54.876981 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:54.870902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:39299)
0810 03:45:54.871261 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:54.871279 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:54.871415 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:54.871733 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:54.871736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:54.871960 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:54.872057 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:54.872063 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.872917 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.872920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:54.873607 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:54.873617 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.874251 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.874254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:54.874319 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:54.874827 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:54.874838 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:54.876798 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":112,"threads_started":1}
W20260810 03:45:54.877022 708 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:54.871039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:39299 (local address 127.22.134.254:38477)
0810 03:45:54.871263 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:54.871270 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:54.871351 (+ 81us) server_negotiation.cc:407] Connection header received
0810 03:45:54.871541 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:54.871545 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:54.871601 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:54.871710 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:54.872197 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.872792 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.873746 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:54.874036 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:54.874237 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:54.876921 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:39299: BlockingRecv error: recv got EOF from 127.22.134.194:39299 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
Aug 10 03:45:55 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:55 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:55.075760 710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:55.070278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:35407)
0810 03:45:55.070550 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:55.070564 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:55.070666 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:55.070949 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:55.070951 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:55.071186 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:55.071288 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:55.071293 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.072049 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.072052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:55.072619 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:55.072629 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.073078 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.073081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:55.073180 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:55.073729 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:55.073740 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:55.075615 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":99,"threads_started":1}
W20260810 03:45:55.075860 708 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:55.070427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35407 (local address 127.22.134.254:38477)
0810 03:45:55.070582 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:55.070586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:55.070615 (+ 29us) server_negotiation.cc:407] Connection header received
0810 03:45:55.070783 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:55.070786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:55.070837 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:55.070909 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:55.071397 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.071936 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.072761 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.072978 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.073058 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:55.075763 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:35407: BlockingRecv error: recv got EOF from 127.22.134.195:35407 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 03:45:55 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:55 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:55.679900 711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:55.673168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:57681)
0810 03:45:55.673463 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:55.673480 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:55.673574 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:55.673900 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:55.673903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:55.674179 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:55.674280 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:55.674286 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.675324 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.675327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:55.676284 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:55.676295 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.676772 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.676779 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:55.676892 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:55.677455 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:55.677486 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:55.679763 (+ 2277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":106,"threads_started":1}
W20260810 03:45:55.680053 712 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:55.673349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:57681 (local address 127.22.134.254:38477)
0810 03:45:55.673612 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:55.673617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:55.673634 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:45:55.673680 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:55.673683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:55.673724 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:55.673815 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:55.674455 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.675166 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.676394 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.676611 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.676693 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:55.679912 (+ 3219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:57681: BlockingRecv error: recv got EOF from 127.22.134.193:57681 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":109,"threads_started":1}
Aug 10 03:45:55 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:55 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:55.883853 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:55.877999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:50217)
0810 03:45:55.878318 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:55.878335 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:55.878490 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:55.878791 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:55.878794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:55.879025 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:55.879120 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:55.879126 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.879907 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.879912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:55.880480 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:55.880488 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.881036 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.881040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:55.881127 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:55.881674 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:55.881686 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:55.883735 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":99,"threads_started":1}
W20260810 03:45:55.884099 712 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:55.878118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:50217 (local address 127.22.134.254:38477)
0810 03:45:55.878290 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:55.878294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:55.878432 (+ 138us) server_negotiation.cc:407] Connection header received
0810 03:45:55.878621 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:55.878624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:55.878671 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:55.878768 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:55.879251 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.879789 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.880623 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:55.880907 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:55.881029 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:55.883892 (+ 2863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:50217: BlockingRecv error: recv got EOF from 127.22.134.194:50217 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 10 03:45:56 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:56 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:56.083425 714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:56.076799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:47883)
0810 03:45:56.077281 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:56.077309 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:56.077415 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:56.077714 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:56.077717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:56.078019 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:56.078134 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:56.078141 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.079110 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.079113 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:56.079722 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:56.079731 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.080379 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.080383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:56.080456 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:56.081069 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:56.081081 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:56.083293 (+ 2212us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":88,"threads_started":1}
W20260810 03:45:56.083675 712 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:56.076909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:47883 (local address 127.22.134.254:38477)
0810 03:45:56.077105 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:56.077112 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:56.077424 (+ 312us) server_negotiation.cc:407] Connection header received
0810 03:45:56.077496 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:56.077506 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:56.077554 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:56.077635 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:56.078333 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.078903 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.079860 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.080094 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.080183 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:56.083552 (+ 3369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:47883: BlockingRecv error: recv got EOF from 127.22.134.195:47883 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 10 03:45:56 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:56 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:56.686784 715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:56.680834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:42977)
0810 03:45:56.681172 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:56.681187 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:56.681299 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:56.681587 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:56.681589 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:56.681845 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:56.681948 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:56.681954 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.682773 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.682776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:56.683330 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:56.683338 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.683799 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.683802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:56.683861 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:56.684369 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:56.684381 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:56.686620 (+ 2239us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":93,"threads_started":1}
W20260810 03:45:56.687000 717 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:56.680916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:42977 (local address 127.22.134.254:38477)
0810 03:45:56.681178 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:56.681181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:56.681268 (+ 87us) server_negotiation.cc:407] Connection header received
0810 03:45:56.681385 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:56.681387 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:56.681430 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:56.681542 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:56.682102 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.682643 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.683436 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.683654 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.683777 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:56.686789 (+ 3012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:42977: BlockingRecv error: recv got EOF from 127.22.134.193:42977 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":66,"threads_started":1}
Aug 10 03:45:56 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:56 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:56.890486 718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:56.884710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:47311)
0810 03:45:56.885038 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:56.885053 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:56.885177 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:56.885409 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:56.885411 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:56.885595 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:56.885688 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:56.885693 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.886474 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.886478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:56.887139 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:56.887148 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.887702 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.887710 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:56.887806 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:56.888352 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:56.888364 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:56.890347 (+ 1983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":92,"threads_started":1}
W20260810 03:45:56.890674 717 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:56.884831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:47311 (local address 127.22.134.254:38477)
0810 03:45:56.884989 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:56.884996 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:56.885127 (+ 131us) server_negotiation.cc:407] Connection header received
0810 03:45:56.885260 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:56.885262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:56.885306 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:56.885380 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:56.885786 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.886355 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.887293 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:56.887542 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:56.887638 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:56.890512 (+ 2874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:47311: BlockingRecv error: recv got EOF from 127.22.134.194:47311 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 03:45:57 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:57 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:57.090549 719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:57.084608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:35691)
0810 03:45:57.084925 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:57.084938 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:57.085071 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:57.085377 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:57.085380 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:57.085600 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:57.085700 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:57.085705 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.086553 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.086559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:57.087138 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:57.087147 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.087683 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.087687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:57.087772 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:57.088366 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:57.088378 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:57.090429 (+ 2051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":133,"threads_started":1}
W20260810 03:45:57.090852 717 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:57.084676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35691 (local address 127.22.134.254:38477)
0810 03:45:57.084863 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:57.084869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:57.085009 (+ 140us) server_negotiation.cc:407] Connection header received
0810 03:45:57.085213 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:57.085216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:57.085264 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:57.085355 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:57.085816 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.086446 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.087264 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.087541 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.087674 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:57.090575 (+ 2901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:35691: BlockingRecv error: recv got EOF from 127.22.134.195:35691 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 10 03:45:57 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:57 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:57.693625 720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:57.687549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:45663)
0810 03:45:57.687897 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:57.687921 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:57.688019 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:57.688282 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:57.688285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:57.688470 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:57.688573 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:57.688578 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.689535 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.689538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:57.690109 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:57.690119 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.690674 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.690677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:57.690741 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:57.691398 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:57.691411 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:57.693502 (+ 2091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":78,"threads_started":1}
W20260810 03:45:57.693921 721 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:57.687702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:45663 (local address 127.22.134.254:38477)
0810 03:45:57.688029 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:57.688034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:57.688051 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:45:57.688102 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:57.688105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:57.688151 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:57.688246 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:57.688784 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.689416 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.690267 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.690551 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.690635 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:57.693649 (+ 3014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:45663: BlockingRecv error: recv got EOF from 127.22.134.193:45663 (error 108)
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":110,"threads_started":1}
Aug 10 03:45:57 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:57 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:57.897929 722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:57.891468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:53789)
0810 03:45:57.891842 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:57.891857 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:57.891964 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:57.892251 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:57.892253 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:57.892439 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:57.892559 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:57.892569 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.893620 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.893624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:57.894331 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:57.894349 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.894793 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.894796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:57.894858 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:57.895463 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:57.895474 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:57.897810 (+ 2336us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":111,"threads_started":1}
W20260810 03:45:57.898132 721 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:57.891561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:53789 (local address 127.22.134.254:38477)
0810 03:45:57.891733 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:57.891738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:57.891935 (+ 197us) server_negotiation.cc:407] Connection header received
0810 03:45:57.892084 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:57.892086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:57.892134 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:57.892211 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:57.892693 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.893493 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.894467 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:57.894691 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:57.894777 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:57.897984 (+ 3207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:53789: BlockingRecv error: recv got EOF from 127.22.134.194:53789 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 10 03:45:58 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:58 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:58.098371 723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:58.091347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:47997)
0810 03:45:58.091819 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:58.091840 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:58.092015 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:58.092396 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:58.092399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:58.092653 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:58.092840 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:58.092849 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.093710 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.093716 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:58.094350 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:58.094359 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.094955 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.094959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:58.095057 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:58.095622 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:58.095640 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:58.098183 (+ 2543us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":113,"threads_started":1}
W20260810 03:45:58.098649 721 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:58.091505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:47997 (local address 127.22.134.254:38477)
0810 03:45:58.091778 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:58.091783 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:58.091945 (+ 162us) server_negotiation.cc:407] Connection header received
0810 03:45:58.092194 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:58.092198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:58.092261 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:58.092371 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:58.092979 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.093567 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.094493 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.094810 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.094945 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:58.098356 (+ 3411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:47997: BlockingRecv error: recv got EOF from 127.22.134.195:47997 (error 108)
Metrics: {"server-negotiator.queue_time_us":155}
Aug 10 03:45:58 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:58 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:58.700680 724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:58.694519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:60745)
0810 03:45:58.694818 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:58.694833 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:58.694923 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:58.695290 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:58.695293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:58.695497 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:58.695630 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:58.695636 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.696456 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.696459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:58.697188 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:58.697199 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.697693 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.697696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:58.697761 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:58.698263 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:58.698276 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:58.700489 (+ 2213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":92,"threads_started":1}
W20260810 03:45:58.700855 725 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:58.694696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:60745 (local address 127.22.134.254:38477)
0810 03:45:58.694988 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:58.694993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:58.695010 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:45:58.695060 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:58.695062 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:58.695108 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:58.695206 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:58.695793 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.696335 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.697326 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.697579 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.697672 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:58.700682 (+ 3010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:60745: BlockingRecv error: recv got EOF from 127.22.134.193:60745 (error 108)
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":124,"threads_started":1}
Aug 10 03:45:58 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:58 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:58.906553 726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:58.898910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:56009)
0810 03:45:58.899228 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:58.899247 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:58.899385 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:58.899728 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:58.899732 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:58.899991 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:58.900133 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:58.900142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.901729 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.901733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:58.902772 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:58.902785 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.903356 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.903360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:58.903469 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:58.904060 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:58.904078 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:58.906370 (+ 2292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":109,"threads_started":1}
W20260810 03:45:58.906613 725 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:58.898981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:56009 (local address 127.22.134.254:38477)
0810 03:45:58.899162 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:58.899168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:58.899319 (+ 151us) server_negotiation.cc:407] Connection header received
0810 03:45:58.899505 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:58.899508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:58.899584 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:58.899685 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:58.900262 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.901601 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.902914 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:58.903240 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:58.903317 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:58.906505 (+ 3188us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:56009: BlockingRecv error: recv got EOF from 127.22.134.194:56009 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 03:45:59 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:59 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:59.105665 727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:59.099429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:57691)
0810 03:45:59.099813 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:59.099832 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:59.100007 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:59.100311 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:59.100314 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:59.100579 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:59.100686 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:59.100693 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.101548 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.101553 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:59.102186 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:59.102195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.102696 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.102699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:59.102788 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:59.103418 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:59.103438 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:59.105513 (+ 2075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":100,"threads_started":1}
W20260810 03:45:59.105789 725 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:59.099594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:57691 (local address 127.22.134.254:38477)
0810 03:45:59.099803 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:59.099809 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:59.099934 (+ 125us) server_negotiation.cc:407] Connection header received
0810 03:45:59.100128 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:59.100132 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:59.100189 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:59.100282 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:59.100863 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.101426 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.102325 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.102558 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.102690 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:59.105665 (+ 2975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:57691: BlockingRecv error: recv got EOF from 127.22.134.195:57691 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 10 03:45:59 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:59 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:59.711982 728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:59.701641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:44071)
0810 03:45:59.701954 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:59.701970 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:59.702089 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:59.702398 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:59.702400 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:59.702600 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:59.702697 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:59.702702 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.703480 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.703483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:59.704069 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:59.704079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.704520 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.704523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:59.704587 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:59.709748 (+ 5161us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:59.709762 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:59.711805 (+ 2043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":98,"threads_started":1}
W20260810 03:45:59.712091 729 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:59.701710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:44071 (local address 127.22.134.254:38477)
0810 03:45:59.701970 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:59.701973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:59.702192 (+ 219us) server_negotiation.cc:407] Connection header received
0810 03:45:59.702241 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:59.702243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:59.702287 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:59.702364 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:59.702801 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.703362 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.704196 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.704420 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.704498 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:59.711952 (+ 7454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:44071: BlockingRecv error: recv got EOF from 127.22.134.193:44071 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":75,"threads_started":1}
Aug 10 03:45:59 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:45:59 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:45:59.913146 730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:45:59.907630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:34861)
0810 03:45:59.907906 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0810 03:45:59.907921 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:45:59.908023 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:45:59.908256 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:45:59.908259 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:45:59.908446 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:45:59.908542 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:59.908547 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.909354 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.909356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:59.909921 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:45:59.909928 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.910344 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.910347 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:45:59.910408 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:59.910939 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:45:59.910951 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:45:59.912970 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":98,"threads_started":1}
W20260810 03:45:59.913412 729 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:45:59.907698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:34861 (local address 127.22.134.254:38477)
0810 03:45:59.907866 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:45:59.907869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:45:59.907996 (+ 127us) server_negotiation.cc:407] Connection header received
0810 03:45:59.908094 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:45:59.908097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:45:59.908140 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:45:59.908223 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:45:59.908648 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.909252 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.910024 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:45:59.910238 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:45:59.910315 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:45:59.913140 (+ 2825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:34861: BlockingRecv error: recv got EOF from 127.22.134.194:34861 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 10 03:46:00 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:00 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:00.112401 732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:00.106580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:41797)
0810 03:46:00.106876 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:00.106892 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:00.107015 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:00.107387 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:00.107389 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:00.107585 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:00.107688 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:00.107694 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.108461 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.108463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:00.109118 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:00.109127 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.109568 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.109570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:00.109640 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:00.110165 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:00.110177 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:00.112257 (+ 2080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":109,"threads_started":1}
W20260810 03:46:00.112596 729 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:00.106663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:41797 (local address 127.22.134.254:38477)
0810 03:46:00.106802 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:00.106807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:00.106981 (+ 174us) server_negotiation.cc:407] Connection header received
0810 03:46:00.107161 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:00.107200 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:00.107261 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:00.107340 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:00.107796 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.108359 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.109243 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.109465 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.109543 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:00.112419 (+ 2876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:41797: BlockingRecv error: recv got EOF from 127.22.134.195:41797 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 10 03:46:00 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:00 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:00.719318 733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:00.713105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:45965)
0810 03:46:00.713457 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:00.713508 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:00.713615 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:00.713893 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:00.713896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:00.714092 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:00.714203 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:00.714209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.715001 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.715004 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:00.715574 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:00.715583 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.716096 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.716100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:00.716205 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:00.717005 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:00.717018 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:00.719193 (+ 2175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":87,"threads_started":1}
W20260810 03:46:00.719480 734 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:00.713304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:45965 (local address 127.22.134.254:38477)
0810 03:46:00.713593 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:00.713597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:00.713615 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:46:00.713691 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:00.713693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:00.713734 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:00.713818 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:00.714330 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.714876 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.715693 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.715942 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.716074 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:00.719345 (+ 3271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:45965: BlockingRecv error: recv got EOF from 127.22.134.193:45965 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":93,"threads_started":1}
Aug 10 03:46:00 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:00 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:00.919915 735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:00.913993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:59107)
0810 03:46:00.914400 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:00.914415 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:00.914545 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:00.914825 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:00.914828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:00.915046 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:00.915137 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:00.915142 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.915934 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.915940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:00.916507 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:00.916515 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.917052 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.917055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:00.917141 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:00.917683 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:00.917696 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:00.919723 (+ 2027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":112,"threads_started":1}
W20260810 03:46:00.920099 734 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:00.914179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:59107 (local address 127.22.134.254:38477)
0810 03:46:00.914354 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:00.914359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:00.914490 (+ 131us) server_negotiation.cc:407] Connection header received
0810 03:46:00.914649 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:00.914653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:00.914709 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:00.914801 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:00.915275 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.915820 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.916633 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:00.916932 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:00.917045 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:00.919876 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:59107: BlockingRecv error: recv got EOF from 127.22.134.194:59107 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 10 03:46:01 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:01 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:01.119364 736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:01.113399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:51697)
0810 03:46:01.113796 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:01.113813 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:01.113932 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:01.114241 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:01.114244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:01.114471 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:01.114570 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:01.114576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.115342 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.115347 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:01.115967 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:01.115976 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.116462 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.116466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:01.116556 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:01.117259 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:01.117271 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:01.119241 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":144,"threads_started":1}
W20260810 03:46:01.119618 734 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:01.113546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:51697 (local address 127.22.134.254:38477)
0810 03:46:01.113705 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:01.113709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:01.113893 (+ 184us) server_negotiation.cc:407] Connection header received
0810 03:46:01.114046 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:01.114050 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:01.114107 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:01.114198 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:01.114699 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.115230 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.116095 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.116334 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.116445 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:01.119456 (+ 3011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:51697: BlockingRecv error: recv got EOF from 127.22.134.195:51697 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 10 03:46:01 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:01 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:01.726025 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:01.720047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:55457)
0810 03:46:01.720348 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:01.720367 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:01.720485 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:01.720798 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:01.720800 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:01.721046 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:01.721150 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:01.721156 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.721962 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.722008 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:01.722569 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:01.722578 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.723111 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.723114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:01.723189 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:01.723707 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:01.723720 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:01.725827 (+ 2107us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":69,"threads_started":1}
W20260810 03:46:01.726120 738 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:01.720214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:55457 (local address 127.22.134.254:38477)
0810 03:46:01.720479 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:01.720482 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:01.720496 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:46:01.720577 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:01.720579 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:01.720624 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:01.720755 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:01.721259 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.721810 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.722717 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.722941 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.723017 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:01.725968 (+ 2951us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:55457: BlockingRecv error: recv got EOF from 127.22.134.193:55457 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":81,"threads_started":1}
Aug 10 03:46:01 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:01 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:01.927062 739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:01.920894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:35833)
0810 03:46:01.921255 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:01.921269 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:01.921399 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:01.921692 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:01.921695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:01.921922 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:01.922018 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:01.922024 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.922812 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.922817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:01.923412 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:01.923421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.923894 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.923897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:01.923984 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:01.924594 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:01.924606 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:01.926852 (+ 2246us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":103,"threads_started":1}
W20260810 03:46:01.927175 738 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:01.920920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:35833 (local address 127.22.134.254:38477)
0810 03:46:01.921107 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:01.921112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:01.921351 (+ 239us) server_negotiation.cc:407] Connection header received
0810 03:46:01.921514 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:01.921519 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:01.921577 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:01.921673 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:01.922146 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.922693 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.923547 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:01.923774 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:01.923886 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:01.927040 (+ 3154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:35833: BlockingRecv error: recv got EOF from 127.22.134.194:35833 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 10 03:46:02 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:02 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:02.126650 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:02.120321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:39465)
0810 03:46:02.120849 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:02.120865 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:02.121013 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:02.121338 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:02.121341 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:02.121575 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:02.121683 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:02.121689 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.122489 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.122494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:02.123074 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:02.123083 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.123556 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.123560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:02.123647 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:02.124235 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:02.124247 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:02.126475 (+ 2228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":99,"threads_started":1}
W20260810 03:46:02.126713 738 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:02.120453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:39465 (local address 127.22.134.254:38477)
0810 03:46:02.120788 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:02.120793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:02.120952 (+ 159us) server_negotiation.cc:407] Connection header received
0810 03:46:02.121137 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:02.121141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:02.121224 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:02.121313 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:02.121811 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.122374 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.123206 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.123435 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.123547 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:02.126604 (+ 3057us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:39465: BlockingRecv error: recv got EOF from 127.22.134.195:39465 (error 108)
Metrics: {"server-negotiator.queue_time_us":194}
Aug 10 03:46:02 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:02 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:02.733090 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:02.727144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:47197)
0810 03:46:02.727526 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:02.727541 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:02.727650 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:02.727924 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:02.727927 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:02.728113 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:02.728222 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:02.728228 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.729157 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.729160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:02.729720 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:02.729728 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.730218 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.730221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:02.730279 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:02.730840 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:02.730853 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:02.732944 (+ 2091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":94,"threads_started":1}
W20260810 03:46:02.733280 741 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:02.727144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:47197 (local address 127.22.134.254:38477)
0810 03:46:02.727462 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:02.727466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:02.727622 (+ 156us) server_negotiation.cc:407] Connection header received
0810 03:46:02.727720 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:02.727722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:02.727767 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:02.727847 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:02.728364 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.729023 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.729837 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.730105 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.730195 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:02.733117 (+ 2922us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:47197: BlockingRecv error: recv got EOF from 127.22.134.193:47197 (error 108)
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":91,"threads_started":1}
Aug 10 03:46:02 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:02 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:02.934231 743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:02.927991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:58459)
0810 03:46:02.928392 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:02.928417 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:02.928564 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:02.928884 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:02.928887 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:02.929128 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:02.929225 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:02.929231 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.930025 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.930031 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:02.930646 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:02.930655 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.931128 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.931131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:02.931219 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:02.931797 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:02.931809 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:02.933998 (+ 2189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":126,"threads_started":1}
W20260810 03:46:02.934259 741 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:02.928154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:58459 (local address 127.22.134.254:38477)
0810 03:46:02.928359 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:02.928364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:02.928500 (+ 136us) server_negotiation.cc:407] Connection header received
0810 03:46:02.928683 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:02.928686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:02.928766 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:02.928859 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:02.929355 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.929909 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.930778 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:02.931005 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:02.931120 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:02.934152 (+ 3032us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:58459: BlockingRecv error: recv got EOF from 127.22.134.194:58459 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 10 03:46:03 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:03 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:03.134114 745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:03.127895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:46689)
0810 03:46:03.128191 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:03.128206 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:03.128310 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:03.128630 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:03.128632 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:03.128846 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:03.128969 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:03.128975 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.129841 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.129845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:03.130605 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:03.130616 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.131193 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.131197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:03.131284 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:03.131874 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:03.131886 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:03.133925 (+ 2039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":102,"threads_started":1}
W20260810 03:46:03.134173 741 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:03.128032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:46689 (local address 127.22.134.254:38477)
0810 03:46:03.128210 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:03.128214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:03.128299 (+ 85us) server_negotiation.cc:407] Connection header received
0810 03:46:03.128438 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:03.128441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:03.128492 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:03.128582 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:03.129175 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.129717 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.130756 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.131010 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.131127 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:03.134055 (+ 2928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:46689: BlockingRecv error: recv got EOF from 127.22.134.195:46689 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 10 03:46:03 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:03 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:03.740253 746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:03.734003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:32847)
0810 03:46:03.734377 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:03.734392 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:03.734489 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:03.734887 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:03.734890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:03.735088 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:03.735188 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:03.735194 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.736028 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.736038 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:03.736615 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:03.736623 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.737451 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.737454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:03.737529 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:03.738162 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:03.738174 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:03.740132 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":126,"threads_started":1}
W20260810 03:46:03.740478 747 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:03.734111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:32847 (local address 127.22.134.254:38477)
0810 03:46:03.734418 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:03.734422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:03.734440 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:46:03.734635 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:03.734638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:03.734688 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:03.734784 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:03.735315 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.735904 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.737033 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.737308 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.737406 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:03.740331 (+ 2925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:32847: BlockingRecv error: recv got EOF from 127.22.134.193:32847 (error 108)
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":147,"threads_started":1}
Aug 10 03:46:03 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:03 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:03.941535 748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:03.935311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:56369)
0810 03:46:03.935658 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:03.935676 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:03.935835 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:03.936144 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:03.936147 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:03.936370 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:03.936461 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:03.936467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.937341 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.937346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:03.938022 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:03.938031 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.938504 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.938508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:03.938587 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:03.939271 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:03.939283 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:03.941340 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":109,"threads_started":1}
W20260810 03:46:03.941591 747 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:03.935477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:56369 (local address 127.22.134.254:38477)
0810 03:46:03.935662 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:03.935669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:03.935759 (+ 90us) server_negotiation.cc:407] Connection header received
0810 03:46:03.935950 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:03.935954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:03.936016 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:03.936122 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:03.936583 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.937230 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.938147 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:03.938388 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:03.938506 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:03.941474 (+ 2968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:56369: BlockingRecv error: recv got EOF from 127.22.134.194:56369 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 10 03:46:04 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:04 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:04.141819 749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:04.135168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:35099)
0810 03:46:04.135544 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:04.135560 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:04.135671 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:04.135976 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:04.135980 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:04.136189 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:04.136289 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:04.136295 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.137202 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.137205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:04.137951 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:04.137962 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.138576 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.138579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:04.138650 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:04.139332 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:04.139345 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:04.141622 (+ 2277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":103,"threads_started":1}
W20260810 03:46:04.141925 747 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:04.135156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35099 (local address 127.22.134.254:38477)
0810 03:46:04.135355 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:04.135360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:04.135648 (+ 288us) server_negotiation.cc:407] Connection header received
0810 03:46:04.135764 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:04.135767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:04.135819 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:04.135900 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:04.136431 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.137084 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.138179 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.138455 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.138548 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:04.141803 (+ 3255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:35099: BlockingRecv error: recv got EOF from 127.22.134.195:35099 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 10 03:46:04 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:04 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:04.753741 750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:04.741257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:44029)
0810 03:46:04.741591 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:04.741610 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:04.741728 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:04.742088 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:04.742092 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:04.742335 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:04.742469 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:04.742476 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.743687 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.743690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:04.744811 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:04.744821 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.745500 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.745503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:04.745611 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:04.751208 (+ 5597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:04.751228 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:04.753559 (+ 2331us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":90,"threads_started":1}
W20260810 03:46:04.753924 751 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:04.741280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:44029 (local address 127.22.134.254:38477)
0810 03:46:04.741631 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:04.741636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:04.741716 (+ 80us) server_negotiation.cc:407] Connection header received
0810 03:46:04.741869 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:04.741872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:04.741930 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:04.742019 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:04.742593 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.743543 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.744941 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.745363 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.745498 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:04.753775 (+ 8277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:44029: BlockingRecv error: recv got EOF from 127.22.134.193:44029 (error 108)
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":59,"threads_started":1}
Aug 10 03:46:04 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:04 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:04.948457 752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:04.942509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:42411)
0810 03:46:04.942789 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:04.942804 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:04.942902 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:04.943177 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:04.943179 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:04.943370 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:04.943465 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:04.943470 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.944218 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.944220 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:04.944926 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:04.944940 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.945542 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.945545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:04.945644 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:04.946241 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:04.946261 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:04.948328 (+ 2067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":74,"threads_started":1}
W20260810 03:46:04.948624 751 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:04.942635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:42411 (local address 127.22.134.254:38477)
0810 03:46:04.942832 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:04.942836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:04.942856 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:46:04.943016 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:04.943018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:04.943066 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:04.943141 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:04.943572 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.944119 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.945064 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:04.945333 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:04.945418 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:04.948468 (+ 3050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:42411: BlockingRecv error: recv got EOF from 127.22.134.194:42411 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 10 03:46:05 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:05 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.195@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:05.148988 753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:05.142854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.195:57249)
0810 03:46:05.143170 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:05.143184 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:05.143286 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:05.143580 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:05.143583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:05.143777 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:05.143876 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:05.143888 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.144630 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.144633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:05.145306 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:05.145316 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.145829 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.145832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:05.145892 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:05.146550 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:05.146566 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:05.148748 (+ 2182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":113,"threads_started":1}
W20260810 03:46:05.149066 751 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:05.142993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:57249 (local address 127.22.134.254:38477)
0810 03:46:05.143137 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:05.143140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:05.143277 (+ 137us) server_negotiation.cc:407] Connection header received
0810 03:46:05.143369 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:05.143372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:05.143420 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:05.143495 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:05.143995 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.144522 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.145425 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.145718 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.145803 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:05.148924 (+ 3121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.195:57249: BlockingRecv error: recv got EOF from 127.22.134.195:57249 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 03:46:05 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:05 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.193@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:05.761404 754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:05.755193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.193:39815)
0810 03:46:05.755540 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:05.755556 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:05.755682 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:05.755999 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:05.756003 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:05.756200 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:05.756302 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:05.756308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.757152 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.757155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:05.757805 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:05.757815 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.758294 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.758298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:05.758378 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:05.759097 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:05.759111 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:05.761246 (+ 2135us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":116,"threads_started":1}
W20260810 03:46:05.761570 755 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:05.755309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:39815 (local address 127.22.134.254:38477)
0810 03:46:05.755548 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:05.755552 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:05.755647 (+ 95us) server_negotiation.cc:407] Connection header received
0810 03:46:05.755788 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:05.755791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:05.755835 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:05.755917 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:05.756421 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.757003 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.757923 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.758140 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.758267 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:05.761388 (+ 3121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.193:39815: BlockingRecv error: recv got EOF from 127.22.134.193:39815 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":94,"threads_started":1}
Aug 10 03:46:05 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 03:46:05 dist-test-slave-qg60 krb5kdc[32057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.134.194@KRBTEST.COM for oryx/127.22.134.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 03:46:05.956444 756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:05.949641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38477 (local address 127.22.134.194:56121)
0810 03:46:05.949997 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:05.950014 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:05.950230 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:05.950550 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:05.950553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:05.950792 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:05.950891 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:05.950896 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.951819 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.951826 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:05.952575 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:05.952586 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.953151 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.953155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:05.953249 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:05.953870 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:05.953883 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:05.956267 (+ 2384us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.134.254:38477: Server oryx/127.22.134.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":93,"threads_started":1}
W20260810 03:46:05.956682 755 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:05.949770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:56121 (local address 127.22.134.254:38477)
0810 03:46:05.949964 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:05.949969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:05.950168 (+ 199us) server_negotiation.cc:407] Connection header received
0810 03:46:05.950362 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:05.950365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:05.950424 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:05.950526 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:05.951027 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.951678 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.952714 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:05.953011 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:05.953143 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:05.956484 (+ 3341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.134.194:56121: BlockingRecv error: recv got EOF from 127.22.134.194:56121 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 03:46:06.028050 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 32697
I20260810 03:46:06.038448 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 401
I20260810 03:46:06.048022 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 544
I20260810 03:46:06.056456 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 32622
2026-08-10T03:46:06Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18299 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T03:46:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:46:06Z Disabled control of system clock
I20260810 03:46:06.090878 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38377
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 03:46:06.209739 761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:06.210029 761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:06.210064 761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:06.214102 761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:46:06.214171 761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:06.214192 761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:06.214211 761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:46:06.214226 761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:46:06.219134 761 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38377
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:06.220247 761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:06.221729 761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:06.231089 771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:06.231187 768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:06.231125 767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:06.231338 761 server_base.cc:1034] running on GCE node
I20260810 03:46:06.231904 761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:06.233206 761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:06.234416 761 hybrid_clock.cc:648] HybridClock initialized: now 1786333566234401 us; error 27 us; skew 500 ppm
I20260810 03:46:06.236562 761 webserver.cc:460] Webserver started at http://127.22.134.254:33857/ using document root <none> and password file <none>
I20260810 03:46:06.237290 761 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:06.237425 761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:06.237691 761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:06.239974 761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "9152331cbd7749b09ff8fcc21caea69a"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "a19206ef637fa0f39edea6b8e1930b5e"
server_key_iv: "6bb41d493ce3962bd49a9a6b5cc4cdb5"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.240635 761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "9152331cbd7749b09ff8fcc21caea69a"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "a19206ef637fa0f39edea6b8e1930b5e"
server_key_iv: "6bb41d493ce3962bd49a9a6b5cc4cdb5"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.245056 761 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:46:06.248198 777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.249662 761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:46:06.249830 761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "9152331cbd7749b09ff8fcc21caea69a"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "a19206ef637fa0f39edea6b8e1930b5e"
server_key_iv: "6bb41d493ce3962bd49a9a6b5cc4cdb5"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.249936 761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:06.275496 761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:06.276252 761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:06.276417 761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:06.284402 761 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:38377
I20260810 03:46:06.284427 836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:38377 every 8 connection(s)
I20260810 03:46:06.285461 761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:46:06.287981 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 761
I20260810 03:46:06.288125 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:46:06.288455 23067 external_mini_cluster.cc:1428] Setting key 8bb82cc549558ad9b4f48c92cbb92174
I20260810 03:46:06.289140 837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:46:06.296677 837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a: Bootstrap starting.
I20260810 03:46:06.299561 837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a: Neither blocks nor log segments found. Creating new log.
I20260810 03:46:06.300117 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:06.290156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49706 (local address 127.22.134.254:38377)
0810 03:46:06.290867 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:06.290887 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:06.290930 (+ 43us) server_negotiation.cc:407] Connection header received
0810 03:46:06.291900 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:06.291927 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:06.292465 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:06.292891 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:06.293353 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.294792 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.295818 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.296517 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.296699 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:06.297811 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:06.297820 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:06.297841 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:46:06.298390 (+ 549us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:06.298460 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:46:06.298488 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:06.298593 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:06.298764 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 03:46:06.299056 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":140,"threads_started":1}
I20260810 03:46:06.300518 837 log.cc:824] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:46:06.302824 837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a: No bootstrap required, opened a new log
I20260810 03:46:06.306367 837 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152331cbd7749b09ff8fcc21caea69a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38377 } }
I20260810 03:46:06.306595 837 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:46:06.306630 837 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9152331cbd7749b09ff8fcc21caea69a, State: Initialized, Role: FOLLOWER
I20260810 03:46:06.307097 837 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152331cbd7749b09ff8fcc21caea69a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38377 } }
I20260810 03:46:06.307262 837 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:46:06.307389 837 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:46:06.307523 837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:46:06.308547 837 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152331cbd7749b09ff8fcc21caea69a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38377 } }
I20260810 03:46:06.308909 837 leader_election.cc:302] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9152331cbd7749b09ff8fcc21caea69a; no voters:
I20260810 03:46:06.309223 837 leader_election.cc:288] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:46:06.309348 842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:46:06.309548 842 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [term 1 LEADER]: Becoming Leader. State: Replica: 9152331cbd7749b09ff8fcc21caea69a, State: Running, Role: LEADER
I20260810 03:46:06.309851 842 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152331cbd7749b09ff8fcc21caea69a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38377 } }
I20260810 03:46:06.310465 837 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:46:06.311542 843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9152331cbd7749b09ff8fcc21caea69a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152331cbd7749b09ff8fcc21caea69a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38377 } } }
I20260810 03:46:06.311689 843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [sys.catalog]: This master's current role is: LEADER
I20260810 03:46:06.312078 855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:46:06.312086 844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9152331cbd7749b09ff8fcc21caea69a. Latest consensus state: current_term: 1 leader_uuid: "9152331cbd7749b09ff8fcc21caea69a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152331cbd7749b09ff8fcc21caea69a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38377 } } }
I20260810 03:46:06.312786 844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a [sys.catalog]: This master's current role is: LEADER
I20260810 03:46:06.315107 855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:46:06.320897 855 catalog_manager.cc:1347] Generated new cluster ID: 340c03130ce246589dfb784db5e30b0d
I20260810 03:46:06.320977 855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:46:06.334489 855 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:46:06.335500 855 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:46:06.343449 855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9152331cbd7749b09ff8fcc21caea69a: Generated new TSK 0
I20260810 03:46:06.344318 855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:46:06.347524 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38377
--builtin_ntp_servers=127.22.134.212:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 03:46:06.464845 865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:06.465174 865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:06.465256 865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:06.469518 865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:06.469630 865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:06.469734 865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:46:06.474846 865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:06.476099 865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:06.477587 865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:06.487845 871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:06.487860 870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:06.487913 865 server_base.cc:1034] running on GCE node
W20260810 03:46:06.487854 873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:06.488667 865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:06.489425 865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:06.490641 865 hybrid_clock.cc:648] HybridClock initialized: now 1786333566490605 us; error 37 us; skew 500 ppm
I20260810 03:46:06.492674 865 webserver.cc:460] Webserver started at http://127.22.134.193:33819/ using document root <none> and password file <none>
I20260810 03:46:06.493326 865 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:06.493427 865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:06.493664 865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:06.495854 865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "be161b4f5dd04a11bbb18431e4c47597"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "c1f3c519792381cea3f77948550247aa"
server_key_iv: "384906f2cebbc097dffa5f9961c584af"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.496449 865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "be161b4f5dd04a11bbb18431e4c47597"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "c1f3c519792381cea3f77948550247aa"
server_key_iv: "384906f2cebbc097dffa5f9961c584af"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.500296 865 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 03:46:06.503047 880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.504451 865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 03:46:06.504626 865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "be161b4f5dd04a11bbb18431e4c47597"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "c1f3c519792381cea3f77948550247aa"
server_key_iv: "384906f2cebbc097dffa5f9961c584af"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.504832 865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:06.539093 865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:06.539933 865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:06.540174 865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:06.540874 865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:06.541968 865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:06.542048 865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.542222 865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:06.542274 865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.552803 865 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:43025
I20260810 03:46:06.552846 1002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:43025 every 8 connection(s)
I20260810 03:46:06.554072 865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:46:06.555752 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 865
I20260810 03:46:06.555860 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:46:06.556248 23067 external_mini_cluster.cc:1428] Setting key ebd9ef335309abe489dd53627f286d80
I20260810 03:46:06.558503 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38377
--builtin_ntp_servers=127.22.134.212:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 03:46:06.566054 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:06.556131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:51515 (local address 127.22.134.254:38377)
0810 03:46:06.556311 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:06.556317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:06.557701 (+ 1384us) server_negotiation.cc:407] Connection header received
0810 03:46:06.559914 (+ 2213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:06.559916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:06.559964 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:06.560035 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:06.561326 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.562073 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.563371 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.563801 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.563941 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:06.565341 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:06.565348 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:06.565351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:46:06.565373 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:06.565402 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:46:06.565416 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:06.565510 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:06.565717 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 03:46:06.565825 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 03:46:06.566972 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:06.556655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38377 (local address 127.22.134.193:51515)
0810 03:46:06.557524 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:06.557584 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:06.559620 (+ 2036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:06.560255 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:06.560268 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:06.560409 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:06.561163 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:06.561179 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.562225 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.562228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:06.563222 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:06.563232 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.563984 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.563987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:06.564216 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:06.565029 (+ 813us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:46:06.565030 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:06.565078 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:46:06.565154 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:06.565528 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:06.565536 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:06.565541 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:46:06.565651 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 03:46:06.565912 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":160,"threads_started":1}
I20260810 03:46:06.568425 1005 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38377
I20260810 03:46:06.568696 1005 heartbeater.cc:464] Registering TS with master...
I20260810 03:46:06.569320 1005 heartbeater.cc:511] Master 127.22.134.254:38377 requested a full tablet report, sending...
I20260810 03:46:06.570942 793 ts_manager.cc:194] Registered new tserver with Master: be161b4f5dd04a11bbb18431e4c47597 (127.22.134.193:43025)
I20260810 03:46:06.572232 793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.193:51515
W20260810 03:46:06.677215 1009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:06.677506 1009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:06.677546 1009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:06.681888 1009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:06.681960 1009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:06.682018 1009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:46:06.687350 1009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:06.688509 1009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:06.690078 1009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:06.700260 1018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:06.700263 1015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:06.700426 1016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:06.700557 1009 server_base.cc:1034] running on GCE node
I20260810 03:46:06.701196 1009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:06.701953 1009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:06.703157 1009 hybrid_clock.cc:648] HybridClock initialized: now 1786333566703112 us; error 61 us; skew 500 ppm
I20260810 03:46:06.705304 1009 webserver.cc:460] Webserver started at http://127.22.134.194:42043/ using document root <none> and password file <none>
I20260810 03:46:06.705977 1009 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:06.706095 1009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:06.706378 1009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:06.709364 1009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "f349c0dc99e24a4c9f9a5f92d93a2307"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "bbe031bf466bb0eef943d05da0f36f75"
server_key_iv: "b357f27c3cd42c6346a1c87874f388c2"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.710031 1009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "f349c0dc99e24a4c9f9a5f92d93a2307"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "bbe031bf466bb0eef943d05da0f36f75"
server_key_iv: "b357f27c3cd42c6346a1c87874f388c2"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.714517 1009 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:46:06.717535 1024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.718887 1009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:46:06.718997 1009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "f349c0dc99e24a4c9f9a5f92d93a2307"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "bbe031bf466bb0eef943d05da0f36f75"
server_key_iv: "b357f27c3cd42c6346a1c87874f388c2"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.719164 1009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:06.755677 1009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:06.756387 1009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:06.756557 1009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:06.757280 1009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:06.758263 1009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:06.758314 1009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.758355 1009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:06.758379 1009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.767477 1009 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:38503
I20260810 03:46:06.767506 1152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:38503 every 8 connection(s)
I20260810 03:46:06.768447 1009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:46:06.777848 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 1009
I20260810 03:46:06.777980 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:46:06.778352 23067 external_mini_cluster.cc:1428] Setting key 91ca1b956c419ac4d369fa778ad9455f
I20260810 03:46:06.778591 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:06.770486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:44021 (local address 127.22.134.254:38377)
0810 03:46:06.770658 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:06.770662 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:06.771790 (+ 1128us) server_negotiation.cc:407] Connection header received
0810 03:46:06.773362 (+ 1572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:06.773365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:06.773420 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:06.773498 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:06.774487 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.775010 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.776253 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.776473 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.776584 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:06.777879 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:06.777882 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:06.777884 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:46:06.777897 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:06.777915 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:46:06.777922 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:06.778050 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:06.778333 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 03:46:06.778392 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 03:46:06.779597 1155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:06.770902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38377 (local address 127.22.134.194:44021)
0810 03:46:06.771624 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:06.771674 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:06.773136 (+ 1462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:06.773669 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:06.773675 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:06.773760 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:06.774340 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:06.774354 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.775136 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.775139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:06.776106 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:06.776116 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.776648 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.776652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:06.776839 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:06.777541 (+ 702us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:46:06.777545 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:06.777604 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:46:06.777697 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:06.778123 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:06.778135 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:06.778142 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:46:06.778303 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 03:46:06.778622 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":120,"threads_started":1}
I20260810 03:46:06.780500 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38377
--builtin_ntp_servers=127.22.134.212:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 03:46:06.780891 1153 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38377
I20260810 03:46:06.781126 1153 heartbeater.cc:464] Registering TS with master...
I20260810 03:46:06.781705 1153 heartbeater.cc:511] Master 127.22.134.254:38377 requested a full tablet report, sending...
I20260810 03:46:06.782788 793 ts_manager.cc:194] Registered new tserver with Master: f349c0dc99e24a4c9f9a5f92d93a2307 (127.22.134.194:38503)
I20260810 03:46:06.783442 793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.194:44021
W20260810 03:46:06.897778 1156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:06.898056 1156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:06.898093 1156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:06.902406 1156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:06.902478 1156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:06.902535 1156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:46:06.907745 1156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:38377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:06.909091 1156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:06.910635 1156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:06.921156 1164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:06.921200 1163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:06.921375 1156 server_base.cc:1034] running on GCE node
W20260810 03:46:06.921156 1166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:06.921912 1156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:06.922641 1156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:06.923838 1156 hybrid_clock.cc:648] HybridClock initialized: now 1786333566923817 us; error 36 us; skew 500 ppm
I20260810 03:46:06.925848 1156 webserver.cc:460] Webserver started at http://127.22.134.195:34737/ using document root <none> and password file <none>
I20260810 03:46:06.926479 1156 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:06.926581 1156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:06.926834 1156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:06.929196 1156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "db1c339fb80743519a2e20f0e39bfbc1"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "899187ee1aee331f9dc174a13b1a6722"
server_key_iv: "364bd0cd216c10fe0e83da93490da2d2"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.929817 1156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "db1c339fb80743519a2e20f0e39bfbc1"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "899187ee1aee331f9dc174a13b1a6722"
server_key_iv: "364bd0cd216c10fe0e83da93490da2d2"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.933821 1156 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:46:06.936699 1172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.938278 1156 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:46:06.938439 1156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "db1c339fb80743519a2e20f0e39bfbc1"
format_stamp: "Formatted at 2026-08-10 03:46:06 on dist-test-slave-qg60"
server_key: "899187ee1aee331f9dc174a13b1a6722"
server_key_iv: "364bd0cd216c10fe0e83da93490da2d2"
server_key_version: "encryptionkey@0"
I20260810 03:46:06.938589 1156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:06.950284 1156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:06.951054 1156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:06.951319 1156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:06.951941 1156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:06.953085 1156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:06.953146 1156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.953213 1156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:06.953248 1156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:06.962517 1156 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:38195
I20260810 03:46:06.962584 1301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:38195 every 8 connection(s)
I20260810 03:46:06.963511 1156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:46:06.968659 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 1156
I20260810 03:46:06.968818 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:46:06.969130 23067 external_mini_cluster.cc:1428] Setting key a3bbadc430c41935b7eb5e8b11304d08
I20260810 03:46:06.973654 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:06.965504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:56271 (local address 127.22.134.254:38377)
0810 03:46:06.965646 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:06.965650 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:06.966709 (+ 1059us) server_negotiation.cc:407] Connection header received
0810 03:46:06.968191 (+ 1482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:06.968195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:06.968262 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:06.968393 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:06.969525 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.970284 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.971591 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.971810 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.971894 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:06.973141 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:06.973145 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:06.973147 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:46:06.973161 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:06.973181 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:46:06.973189 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:06.973253 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:06.973451 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 03:46:06.973522 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:46:06.974553 1304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:06.965868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38377 (local address 127.22.134.195:56271)
0810 03:46:06.966543 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:06.966586 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:06.967949 (+ 1363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:06.968564 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:06.968571 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:06.968657 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:06.969349 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:06.969365 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.970441 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.970445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:06.971475 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:06.971486 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:06.971950 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:06.971953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:06.972102 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:06.972824 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:46:06.972826 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:06.972870 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:46:06.972940 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:06.973270 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:06.973276 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:06.973281 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:46:06.973383 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 03:46:06.973627 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":109,"threads_started":1}
I20260810 03:46:06.976014 1302 heartbeater.cc:347] Connected to a master server at 127.22.134.254:38377
I20260810 03:46:06.976287 1302 heartbeater.cc:464] Registering TS with master...
I20260810 03:46:06.976927 1302 heartbeater.cc:511] Master 127.22.134.254:38377 requested a full tablet report, sending...
I20260810 03:46:06.978087 793 ts_manager.cc:194] Registered new tserver with Master: db1c339fb80743519a2e20f0e39bfbc1 (127.22.134.195:38195)
I20260810 03:46:06.978786 793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.195:56271
I20260810 03:46:06.983443 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 03:46:06.986605 840 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:06.985488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49714 (local address 127.22.134.254:38377)
0810 03:46:06.985648 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:06.985653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:06.985840 (+ 187us) server_negotiation.cc:407] Connection header received
0810 03:46:06.986026 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:06.986028 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:06.986114 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:06.986211 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:06.986423 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49714: BlockingRecv error: recv got EOF from 127.0.0.1:49714 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:46:06.987012 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 865
I20260810 03:46:06.997397 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 1009
I20260810 03:46:07.008153 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 1156
I20260810 03:46:07.017235 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 761
2026-08-10T03:46:07Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (960 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T03:46:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:46:07Z Disabled control of system clock
I20260810 03:46:07.052628 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40953
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:33477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:40953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 03:46:07.174324 1313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:07.174623 1313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:07.174667 1313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:07.179025 1313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:46:07.179095 1313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:07.179111 1313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:07.179134 1313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:46:07.179150 1313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:46:07.184154 1313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:40953
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:07.185406 1313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:07.186815 1313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:07.195959 1318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:07.195959 1319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:07.195982 1321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:07.196529 1313 server_base.cc:1034] running on GCE node
I20260810 03:46:07.197201 1313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:07.198432 1313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:07.199630 1313 hybrid_clock.cc:648] HybridClock initialized: now 1786333567199593 us; error 56 us; skew 500 ppm
I20260810 03:46:07.201781 1313 webserver.cc:460] Webserver started at http://127.22.134.254:36369/ using document root <none> and password file <none>
I20260810 03:46:07.202428 1313 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:07.202497 1313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:07.202687 1313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:07.204893 1313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "7184b8cab74a48079f583fe64d7abd89"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "8860be06c07d56589c4245dad7adad20"
server_key_iv: "1b78b0d3e4d5b34a2fea6ff5cf866de1"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.205443 1313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "7184b8cab74a48079f583fe64d7abd89"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "8860be06c07d56589c4245dad7adad20"
server_key_iv: "1b78b0d3e4d5b34a2fea6ff5cf866de1"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.209487 1313 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:46:07.212064 1327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.213497 1313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:46:07.213656 1313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "7184b8cab74a48079f583fe64d7abd89"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "8860be06c07d56589c4245dad7adad20"
server_key_iv: "1b78b0d3e4d5b34a2fea6ff5cf866de1"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.213791 1313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:07.218912 1313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:07.219646 1313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:07.219843 1313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:07.229701 1390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:40953 every 8 connection(s)
I20260810 03:46:07.229718 1313 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:40953
I20260810 03:46:07.231595 1313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:46:07.236181 1391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:46:07.240653 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 1313
I20260810 03:46:07.240849 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:46:07.241173 23067 external_mini_cluster.cc:1428] Setting key a24a942cea577c72b6686ff0fd87870a
I20260810 03:46:07.242357 1391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89: Bootstrap starting.
I20260810 03:46:07.244874 1391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89: Neither blocks nor log segments found. Creating new log.
I20260810 03:46:07.245847 1391 log.cc:824] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89: Log is configured to *not* fsync() on all Append() calls
I20260810 03:46:07.247372 1394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:07.242658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33178 (local address 127.22.134.254:40953)
0810 03:46:07.243432 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:07.243449 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:07.243494 (+ 45us) server_negotiation.cc:407] Connection header received
0810 03:46:07.244215 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:07.244235 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:07.244624 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:07.245058 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:07.245853 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:07.245858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:07.245870 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:46:07.245880 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:07.245933 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:46:07.245949 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:07.246093 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:07.246250 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 03:46:07.246533 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":135,"threads_started":1}
I20260810 03:46:07.248265 1391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89: No bootstrap required, opened a new log
I20260810 03:46:07.252146 1391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7184b8cab74a48079f583fe64d7abd89" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40953 } }
I20260810 03:46:07.252382 1391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:46:07.252418 1391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7184b8cab74a48079f583fe64d7abd89, State: Initialized, Role: FOLLOWER
I20260810 03:46:07.252892 1391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7184b8cab74a48079f583fe64d7abd89" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40953 } }
I20260810 03:46:07.253023 1391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:46:07.253101 1391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:46:07.253206 1391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:46:07.254191 1391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7184b8cab74a48079f583fe64d7abd89" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40953 } }
I20260810 03:46:07.254585 1391 leader_election.cc:302] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7184b8cab74a48079f583fe64d7abd89; no voters:
I20260810 03:46:07.254981 1391 leader_election.cc:288] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:46:07.255126 1396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:46:07.255358 1396 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [term 1 LEADER]: Becoming Leader. State: Replica: 7184b8cab74a48079f583fe64d7abd89, State: Running, Role: LEADER
I20260810 03:46:07.255788 1396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7184b8cab74a48079f583fe64d7abd89" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40953 } }
I20260810 03:46:07.256587 1391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:46:07.257673 1398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7184b8cab74a48079f583fe64d7abd89. Latest consensus state: current_term: 1 leader_uuid: "7184b8cab74a48079f583fe64d7abd89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7184b8cab74a48079f583fe64d7abd89" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40953 } } }
I20260810 03:46:07.257709 1397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7184b8cab74a48079f583fe64d7abd89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7184b8cab74a48079f583fe64d7abd89" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40953 } } }
I20260810 03:46:07.257869 1398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [sys.catalog]: This master's current role is: LEADER
I20260810 03:46:07.257870 1397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89 [sys.catalog]: This master's current role is: LEADER
I20260810 03:46:07.259024 1405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:46:07.261829 1405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:46:07.267875 1405 catalog_manager.cc:1347] Generated new cluster ID: 6b971a2e583041e4ac5a9e0b404488bd
I20260810 03:46:07.267964 1405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:46:07.283025 1405 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:46:07.283509 1405 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:46:07.291055 1405 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7184b8cab74a48079f583fe64d7abd89: Generated new TSK 0
I20260810 03:46:07.291970 1405 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:46:07.296159 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40953
--builtin_ntp_servers=127.22.134.212:33477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 03:46:07.413952 1418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:07.414233 1418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:07.414280 1418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:07.418530 1418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:07.418599 1418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:07.418659 1418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:46:07.423813 1418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:07.425084 1418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:07.426497 1418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:07.436565 1423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:07.436640 1427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:07.436565 1424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:07.436787 1418 server_base.cc:1034] running on GCE node
I20260810 03:46:07.437333 1418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:07.438042 1418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:07.439236 1418 hybrid_clock.cc:648] HybridClock initialized: now 1786333567439219 us; error 33 us; skew 500 ppm
I20260810 03:46:07.441375 1418 webserver.cc:460] Webserver started at http://127.22.134.193:36335/ using document root <none> and password file <none>
I20260810 03:46:07.441998 1418 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:07.442094 1418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:07.442363 1418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:07.444658 1418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "8ced1f59bc5848dfa5d58f4560d7830c"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "b1c0775740dfd3edfa9f67c471f460fc"
server_key_iv: "66734dd35adcf5cc5a30d7088b8e49a5"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.445317 1418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "8ced1f59bc5848dfa5d58f4560d7830c"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "b1c0775740dfd3edfa9f67c471f460fc"
server_key_iv: "66734dd35adcf5cc5a30d7088b8e49a5"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.449230 1418 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:46:07.452003 1433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.453444 1418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:46:07.453589 1418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "8ced1f59bc5848dfa5d58f4560d7830c"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "b1c0775740dfd3edfa9f67c471f460fc"
server_key_iv: "66734dd35adcf5cc5a30d7088b8e49a5"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.453719 1418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:07.458722 1418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:07.459403 1418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:07.459595 1418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:07.460160 1418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:07.461158 1418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:07.461233 1418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.461308 1418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:07.461364 1418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.470844 1418 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:41685
I20260810 03:46:07.470867 1564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:41685 every 8 connection(s)
I20260810 03:46:07.471976 1418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:46:07.473677 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 1418
I20260810 03:46:07.473799 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:46:07.474152 23067 external_mini_cluster.cc:1428] Setting key 9bea5d7d6af5f9c7d0b54dee5bde4ad6
I20260810 03:46:07.476315 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40953
--builtin_ntp_servers=127.22.134.212:33477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 03:46:07.479008 1394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:07.474065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:58361 (local address 127.22.134.254:40953)
0810 03:46:07.474231 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:07.474238 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:07.475645 (+ 1407us) server_negotiation.cc:407] Connection header received
0810 03:46:07.477162 (+ 1517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:07.477168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:07.477216 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:07.477315 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:07.478573 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:07.478576 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:07.478578 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:46:07.478589 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:07.478609 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:46:07.478617 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:07.478700 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:07.478862 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 03:46:07.478900 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:46:07.480104 1567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:07.474567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40953 (local address 127.22.134.193:58361)
0810 03:46:07.475424 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:07.475482 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:07.476953 (+ 1471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:07.477467 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:07.477474 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:07.477584 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:07.478236 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:46:07.478240 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:07.478314 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:46:07.478412 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:07.478708 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:07.478719 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:07.478725 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:46:07.478909 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 03:46:07.479178 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":147,"threads_started":1}
I20260810 03:46:07.481429 1565 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40953
I20260810 03:46:07.481691 1565 heartbeater.cc:464] Registering TS with master...
I20260810 03:46:07.482136 1565 heartbeater.cc:511] Master 127.22.134.254:40953 requested a full tablet report, sending...
I20260810 03:46:07.483790 1340 ts_manager.cc:194] Registered new tserver with Master: 8ced1f59bc5848dfa5d58f4560d7830c (127.22.134.193:41685)
W20260810 03:46:07.596557 1568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:07.596912 1568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:07.596958 1568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:07.601135 1568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:07.601200 1568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:07.601289 1568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:46:07.606328 1568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:07.607614 1568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:07.609174 1568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:46:07.619539 1568 server_base.cc:1034] running on GCE node
W20260810 03:46:07.619506 1577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:07.619498 1574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:07.619498 1575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:07.620223 1568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:07.621040 1568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:07.622267 1568 hybrid_clock.cc:648] HybridClock initialized: now 1786333567622248 us; error 29 us; skew 500 ppm
I20260810 03:46:07.624330 1568 webserver.cc:460] Webserver started at http://127.22.134.194:45461/ using document root <none> and password file <none>
I20260810 03:46:07.625036 1568 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:07.625154 1568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:07.625403 1568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:07.627552 1568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "b5bbf7c5ef5d4e0c8e059d56e6e4f449"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "c95fd4047da6c017a83540732fa4e267"
server_key_iv: "eb362d64f9b68fe45aa999158da14d02"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.628242 1568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "b5bbf7c5ef5d4e0c8e059d56e6e4f449"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "c95fd4047da6c017a83540732fa4e267"
server_key_iv: "eb362d64f9b68fe45aa999158da14d02"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.633523 1568 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 03:46:07.636478 1583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.637899 1568 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:46:07.638047 1568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "b5bbf7c5ef5d4e0c8e059d56e6e4f449"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "c95fd4047da6c017a83540732fa4e267"
server_key_iv: "eb362d64f9b68fe45aa999158da14d02"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.638181 1568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:07.643072 1568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:07.643734 1568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:07.643925 1568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:07.644488 1568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:07.645565 1568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:07.645613 1568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.645687 1568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:07.645730 1568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.654860 1568 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:34345
I20260810 03:46:07.654946 1712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:34345 every 8 connection(s)
I20260810 03:46:07.655910 1568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:46:07.662922 1394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:07.658181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:43231 (local address 127.22.134.254:40953)
0810 03:46:07.658363 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:07.658369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:07.659666 (+ 1297us) server_negotiation.cc:407] Connection header received
0810 03:46:07.661288 (+ 1622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:07.661292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:07.661336 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:07.661419 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:07.662515 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:07.662518 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:07.662520 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:46:07.662532 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:07.662552 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:46:07.662561 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:07.662641 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:07.662763 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 03:46:07.662806 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:46:07.663898 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:07.658739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40953 (local address 127.22.134.194:43231)
0810 03:46:07.659499 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:07.659550 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:07.661024 (+ 1474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:07.661613 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:07.661621 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:07.661724 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:07.662262 (+ 538us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:46:07.662263 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:07.662304 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:46:07.662372 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:07.662639 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:07.662646 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:07.662650 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 03:46:07.662786 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 03:46:07.663025 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":154,"threads_started":1}
I20260810 03:46:07.665213 1713 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40953
I20260810 03:46:07.665474 1713 heartbeater.cc:464] Registering TS with master...
I20260810 03:46:07.665809 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 1568
I20260810 03:46:07.665944 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:46:07.665961 1713 heartbeater.cc:511] Master 127.22.134.254:40953 requested a full tablet report, sending...
I20260810 03:46:07.666286 23067 external_mini_cluster.cc:1428] Setting key e375fe2e578cea3d821f6a59058ec84d
I20260810 03:46:07.667271 1340 ts_manager.cc:194] Registered new tserver with Master: b5bbf7c5ef5d4e0c8e059d56e6e4f449 (127.22.134.194:34345)
I20260810 03:46:07.668584 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40953
--builtin_ntp_servers=127.22.134.212:33477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 03:46:07.786003 1716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:07.786309 1716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:07.786350 1716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:07.790747 1716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:07.790843 1716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:07.790937 1716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:46:07.797206 1716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:07.798475 1716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:07.799978 1716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:07.810446 1723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:07.810659 1722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:07.810573 1716 server_base.cc:1034] running on GCE node
W20260810 03:46:07.810453 1725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:07.811209 1716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:07.811896 1716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:07.813088 1716 hybrid_clock.cc:648] HybridClock initialized: now 1786333567813052 us; error 50 us; skew 500 ppm
I20260810 03:46:07.815142 1716 webserver.cc:460] Webserver started at http://127.22.134.195:45943/ using document root <none> and password file <none>
I20260810 03:46:07.815817 1716 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:07.815915 1716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:07.816159 1716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:07.818463 1716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "e9b763395d5841d2993a4fa410220111"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "ee409035016db19c95bfe9c63c94192d"
server_key_iv: "ba39043f2455020b4aa6af179aa36f45"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.819082 1716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "e9b763395d5841d2993a4fa410220111"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "ee409035016db19c95bfe9c63c94192d"
server_key_iv: "ba39043f2455020b4aa6af179aa36f45"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.823128 1716 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260810 03:46:07.826195 1731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.827561 1716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:46:07.827714 1716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "e9b763395d5841d2993a4fa410220111"
format_stamp: "Formatted at 2026-08-10 03:46:07 on dist-test-slave-qg60"
server_key: "ee409035016db19c95bfe9c63c94192d"
server_key_iv: "ba39043f2455020b4aa6af179aa36f45"
server_key_version: "encryptionkey@0"
I20260810 03:46:07.827852 1716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:07.832823 1716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:07.833511 1716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:07.833712 1716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:07.834298 1716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:07.835290 1716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:07.835379 1716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.835453 1716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:07.835496 1716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:07.845641 1716 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:39301
I20260810 03:46:07.845661 1859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:39301 every 8 connection(s)
I20260810 03:46:07.846697 1716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:46:07.853711 1394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:07.848833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:52461 (local address 127.22.134.254:40953)
0810 03:46:07.849020 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:07.849025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:07.850156 (+ 1131us) server_negotiation.cc:407] Connection header received
0810 03:46:07.851607 (+ 1451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:07.851610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:07.851652 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:07.851745 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:07.853275 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:07.853278 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:07.853280 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:46:07.853293 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:07.853314 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:46:07.853323 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:07.853412 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:07.853548 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 03:46:07.853589 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:46:07.854839 1863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:07.849277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40953 (local address 127.22.134.195:52461)
0810 03:46:07.849983 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:07.850027 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:07.851371 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:07.851920 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:07.851927 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:07.852022 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:07.852822 (+ 800us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:46:07.852824 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:07.852873 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:46:07.852955 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:07.853413 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:07.853420 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:07.853425 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:46:07.853589 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 03:46:07.853862 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":117,"threads_started":1}
I20260810 03:46:07.856249 1860 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40953
I20260810 03:46:07.856449 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 1716
I20260810 03:46:07.856582 1860 heartbeater.cc:464] Registering TS with master...
I20260810 03:46:07.856585 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:46:07.857050 23067 external_mini_cluster.cc:1428] Setting key c46aba1f2b479bb6bf95c3ec16be3307
I20260810 03:46:07.857206 1860 heartbeater.cc:511] Master 127.22.134.254:40953 requested a full tablet report, sending...
I20260810 03:46:07.858623 1343 ts_manager.cc:194] Registered new tserver with Master: e9b763395d5841d2993a4fa410220111 (127.22.134.195:39301)
I20260810 03:46:07.859663 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 03:46:07.862861 1394 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:46:07.861963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33186 (local address 127.22.134.254:40953)
0810 03:46:07.862112 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:07.862116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:07.862280 (+ 164us) server_negotiation.cc:407] Connection header received
0810 03:46:07.862404 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:07.862406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:07.862437 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:07.862507 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:07.862720 (+ 213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33186: BlockingRecv error: recv got EOF from 127.0.0.1:33186 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:46:07.863209 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 1418
I20260810 03:46:07.873922 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 1568
I20260810 03:46:07.885479 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 1716
I20260810 03:46:07.893898 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 1313
2026-08-10T03:46:07Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (876 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:46:07 dist-test-slave-qg60 krb5kdc[1871](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:46:07 dist-test-slave-qg60 krb5kdc[1871](info): set up 2 sockets
Aug 10 03:46:07 dist-test-slave-qg60 krb5kdc[1871](info): commencing operation
krb5kdc: starting...
W20260810 03:46:09.009320 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:46:09 dist-test-slave-qg60 krb5kdc[1871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:46:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:46:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:46:09.144578 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42721
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:34983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:42721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:46:09.259080 1886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:09.259400 1886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:09.259483 1886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:09.263788 1886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:46:09.263890 1886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:09.263937 1886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:09.263978 1886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:46:09.264015 1886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:46:09.269464 1886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:42721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:09.270612 1886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:09.271656 1886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:09.281112 1891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:09.281126 1892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:09.281489 1886 server_base.cc:1034] running on GCE node
W20260810 03:46:09.281745 1895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:09.282337 1886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:09.283494 1886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:09.284711 1886 hybrid_clock.cc:648] HybridClock initialized: now 1786333569284703 us; error 31 us; skew 500 ppm
Aug 10 03:46:09 dist-test-slave-qg60 krb5kdc[1871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333569, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:46:09.287750 1886 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:46:09.288797 1886 webserver.cc:460] Webserver started at http://127.22.134.254:37997/ using document root <none> and password file <none>
I20260810 03:46:09.289394 1886 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:09.289491 1886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:09.289746 1886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:09.291950 1886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "9812301c8cd64475b99e4f6349fb4522"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "eb08cf1e2d2605880f96651938fe220b"
server_key_iv: "e4de4c369d3698fe25ad7c61d7620c68"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.292560 1886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "9812301c8cd64475b99e4f6349fb4522"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "eb08cf1e2d2605880f96651938fe220b"
server_key_iv: "e4de4c369d3698fe25ad7c61d7620c68"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.296537 1886 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 03:46:09.299116 1904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:09.300350 1886 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 03:46:09.300506 1886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "9812301c8cd64475b99e4f6349fb4522"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "eb08cf1e2d2605880f96651938fe220b"
server_key_iv: "e4de4c369d3698fe25ad7c61d7620c68"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.300626 1886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:09.315949 1886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:09.319427 1886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:09.319651 1886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:09.327512 1886 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:42721
I20260810 03:46:09.327566 1963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:42721 every 8 connection(s)
I20260810 03:46:09.328598 1886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:46:09.331764 1964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:46:09.332616 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 1886
I20260810 03:46:09.332823 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:46:09.333119 23067 external_mini_cluster.cc:1428] Setting key c122e534070c2fa225bc4f3312d40821
I20260810 03:46:09.339357 1964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522: Bootstrap starting.
I20260810 03:46:09.342269 1964 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522: Neither blocks nor log segments found. Creating new log.
I20260810 03:46:09.343232 1964 log.cc:824] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:46:09 dist-test-slave-qg60 krb5kdc[1871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:46:09.346236 1964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522: No bootstrap required, opened a new log
I20260810 03:46:09.350306 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:09.334634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41522 (local address 127.22.134.254:42721)
0810 03:46:09.335139 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:09.335162 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:09.335211 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:46:09.336123 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:09.336153 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:09.336616 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:09.337042 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:09.337905 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.339565 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.340440 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.341271 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.341446 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:09.344473 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:09.344481 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:09.344500 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:46:09.344532 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:09.346731 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:09.347263 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:09.347269 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:09.347275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:09.347432 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:09.347706 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:09.347709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:09.347711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:09.348318 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:09.348557 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:09.348819 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 03:46:09.349208 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":122,"threads_started":1}
I20260810 03:46:09.351402 1964 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9812301c8cd64475b99e4f6349fb4522" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42721 } }
I20260810 03:46:09.351717 1964 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:46:09.351828 1964 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9812301c8cd64475b99e4f6349fb4522, State: Initialized, Role: FOLLOWER
I20260810 03:46:09.352340 1964 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9812301c8cd64475b99e4f6349fb4522" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42721 } }
I20260810 03:46:09.352512 1964 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:46:09.352587 1964 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:46:09.352710 1964 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:46:09.353799 1964 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9812301c8cd64475b99e4f6349fb4522" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42721 } }
I20260810 03:46:09.354182 1964 leader_election.cc:302] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9812301c8cd64475b99e4f6349fb4522; no voters:
I20260810 03:46:09.354529 1964 leader_election.cc:288] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:46:09.354686 1969 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:46:09.354967 1969 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [term 1 LEADER]: Becoming Leader. State: Replica: 9812301c8cd64475b99e4f6349fb4522, State: Running, Role: LEADER
I20260810 03:46:09.355288 1969 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9812301c8cd64475b99e4f6349fb4522" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42721 } }
I20260810 03:46:09.355885 1964 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:46:09.356433 1969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9812301c8cd64475b99e4f6349fb4522. Latest consensus state: current_term: 1 leader_uuid: "9812301c8cd64475b99e4f6349fb4522" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9812301c8cd64475b99e4f6349fb4522" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42721 } } }
I20260810 03:46:09.356550 1969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [sys.catalog]: This master's current role is: LEADER
I20260810 03:46:09.356982 1975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:46:09.357237 1971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9812301c8cd64475b99e4f6349fb4522" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9812301c8cd64475b99e4f6349fb4522" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42721 } } }
I20260810 03:46:09.357357 1971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522 [sys.catalog]: This master's current role is: LEADER
I20260810 03:46:09.360936 1975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:46:09.367231 1975 catalog_manager.cc:1347] Generated new cluster ID: 6a3b16e749e54b919c6f18b989c3fab4
I20260810 03:46:09.367323 1975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:46:09.401826 1975 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:46:09.403199 1975 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:46:09.418984 1975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522: Generated new TSK 0
I20260810 03:46:09.419881 1975 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:46:09.464604 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42721
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:34983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:46:09.586638 1995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:09.586931 1995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:09.586978 1995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:09.591131 1995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:09.591430 1995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:09.591588 1995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:46:09.597254 1995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:09.598416 1995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:09.599493 1995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:09.609494 2002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:09.609501 2001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:09.609769 1995 server_base.cc:1034] running on GCE node
W20260810 03:46:09.609496 2004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:09.610319 1995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:09.610963 1995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:09.612314 1995 hybrid_clock.cc:648] HybridClock initialized: now 1786333569612285 us; error 64 us; skew 500 ppm
Aug 10 03:46:09 dist-test-slave-qg60 krb5kdc[1871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333569, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:46:09.615350 1995 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:46:09.616282 1995 webserver.cc:460] Webserver started at http://127.22.134.193:35635/ using document root <none> and password file <none>
I20260810 03:46:09.616943 1995 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:09.617043 1995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:09.617295 1995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:09.619392 1995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "e34b9693f6024f9094611518bfd3e5aa"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "03750e31577ae68176827b94f43415ce"
server_key_iv: "3a7130c364ea0b761f1470b07c5695f4"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.619979 1995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "e34b9693f6024f9094611518bfd3e5aa"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "03750e31577ae68176827b94f43415ce"
server_key_iv: "3a7130c364ea0b761f1470b07c5695f4"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.623941 1995 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:46:09.626505 2013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:09.627731 1995 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:46:09.627872 1995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "e34b9693f6024f9094611518bfd3e5aa"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "03750e31577ae68176827b94f43415ce"
server_key_iv: "3a7130c364ea0b761f1470b07c5695f4"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.627993 1995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:09.644860 1995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:09.648023 1995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:09.648258 1995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:09.648988 1995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:09.649869 1995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:09.649943 1995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:09.650010 1995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:09.650039 1995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:09.659372 1995 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:44899
I20260810 03:46:09.659418 2137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:44899 every 8 connection(s)
I20260810 03:46:09.660358 1995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:46:09.662953 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 1995
I20260810 03:46:09.663102 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:46:09.663440 23067 external_mini_cluster.cc:1428] Setting key 295f241b7d50ccab5ca851bede1e3fe4
Aug 10 03:46:09 dist-test-slave-qg60 krb5kdc[1871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333569, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:46:09.676489 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:09.662312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:38163 (local address 127.22.134.254:42721)
0810 03:46:09.662460 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:09.662463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:09.663487 (+ 1024us) server_negotiation.cc:407] Connection header received
0810 03:46:09.665301 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:09.665304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:09.665361 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:09.665441 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:09.666657 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.667209 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.668660 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.668987 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.669079 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:09.672375 (+ 3296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:09.672382 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:09.672388 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:46:09.672423 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:09.674395 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:09.674970 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:09.674976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:09.674977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:09.675069 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:09.675383 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:09.675385 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:09.675386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:09.675566 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:09.675664 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:09.676246 (+ 582us) server_negotiation.cc:299] Negotiation successful
0810 03:46:09.676358 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:46:09.677728 2140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:09.662779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42721 (local address 127.22.134.193:38163)
0810 03:46:09.663331 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:09.663378 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:09.665088 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:09.665616 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:09.665623 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:09.665993 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:09.666499 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:09.666513 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.667339 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.667347 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:09.668521 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:09.668536 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.669155 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.669162 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:09.669410 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:09.670212 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:09.670235 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:09.672162 (+ 1927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:09.674518 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:46:09.674523 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:46:09.674537 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:46:09.674868 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:46:09.675158 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:46:09.675160 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:46:09.675161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:46:09.675298 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:46:09.675701 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:09.675706 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:09.676018 (+ 312us) client_negotiation.cc:769] Sending connection context
0810 03:46:09.676187 (+ 169us) client_negotiation.cc:240] Negotiation successful
0810 03:46:09.676457 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":155,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:46:09.679302 2138 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42721
I20260810 03:46:09.679615 2138 heartbeater.cc:464] Registering TS with master...
I20260810 03:46:09.680203 2138 heartbeater.cc:511] Master 127.22.134.254:42721 requested a full tablet report, sending...
I20260810 03:46:09.681988 1921 ts_manager.cc:194] Registered new tserver with Master: e34b9693f6024f9094611518bfd3e5aa (127.22.134.193:44899)
I20260810 03:46:09.683748 1921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:38163
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:46:09.696377 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42721
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:34983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:46:09.811618 2143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:09.811901 2143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:09.811946 2143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:09.815984 2143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:09.816048 2143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:09.816107 2143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:46:09.821530 2143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:09.822688 2143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:09.823673 2143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:09.833767 2149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:09.833834 2152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:09.833884 2143 server_base.cc:1034] running on GCE node
W20260810 03:46:09.833834 2150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:09.834442 2143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:09.835075 2143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:09.836237 2143 hybrid_clock.cc:648] HybridClock initialized: now 1786333569836210 us; error 37 us; skew 500 ppm
Aug 10 03:46:09 dist-test-slave-qg60 krb5kdc[1871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333569, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:46:09.846151 2143 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:46:09.847198 2143 webserver.cc:460] Webserver started at http://127.22.134.194:44923/ using document root <none> and password file <none>
I20260810 03:46:09.847811 2143 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:09.847878 2143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:09.848145 2143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:09.850600 2143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "34dac973be8f41d982fedf57980e8494"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "eaf67511c2b1d07b9be820faa5dca565"
server_key_iv: "580e3133fd43225c7a3f1d522f59360c"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.851207 2143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "34dac973be8f41d982fedf57980e8494"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "eaf67511c2b1d07b9be820faa5dca565"
server_key_iv: "580e3133fd43225c7a3f1d522f59360c"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.855191 2143 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:46:09.857999 2160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:09.859503 2143 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:46:09.859607 2143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "34dac973be8f41d982fedf57980e8494"
format_stamp: "Formatted at 2026-08-10 03:46:09 on dist-test-slave-qg60"
server_key: "eaf67511c2b1d07b9be820faa5dca565"
server_key_iv: "580e3133fd43225c7a3f1d522f59360c"
server_key_version: "encryptionkey@0"
I20260810 03:46:09.859701 2143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:09.870558 2143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:09.874020 2143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:09.874212 2143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:09.874810 2143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:09.875682 2143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:09.875737 2143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:09.875782 2143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:09.875806 2143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:09.886040 2143 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:35109
I20260810 03:46:09.886065 2284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:35109 every 8 connection(s)
I20260810 03:46:09.887027 2143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:46:09.893929 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 2143
I20260810 03:46:09.894055 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:46:09.894368 23067 external_mini_cluster.cc:1428] Setting key c0dc5f3be89bfa51b1c20ad08ff68f4f
Aug 10 03:46:09 dist-test-slave-qg60 krb5kdc[1871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333569, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:46:09.902459 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:09.888901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:56783 (local address 127.22.134.254:42721)
0810 03:46:09.889053 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:09.889057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:09.889968 (+ 911us) server_negotiation.cc:407] Connection header received
0810 03:46:09.891398 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:09.891401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:09.891463 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:09.891568 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:09.892781 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.893330 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.894925 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.895218 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.895323 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:09.898682 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:09.898685 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:09.898687 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:46:09.898713 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:09.900174 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:09.900714 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:09.900718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:09.900720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:09.900838 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:09.901220 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:09.901223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:09.901225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:09.901456 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:09.901561 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:09.902144 (+ 583us) server_negotiation.cc:299] Negotiation successful
0810 03:46:09.902286 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:46:09.903558 2287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:09.889345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42721 (local address 127.22.134.194:56783)
0810 03:46:09.889813 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:09.889855 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:09.891172 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:09.891743 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:09.891750 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:09.892113 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:09.892588 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:09.892600 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.893469 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.893473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:09.894795 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:09.894806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:09.895392 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:09.895399 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:09.895649 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:09.896319 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:09.896342 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:09.898484 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:09.900301 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:46:09.900307 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:46:09.900323 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:46:09.900602 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:46:09.900941 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:46:09.900945 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:46:09.900947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:46:09.901103 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:46:09.901627 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:09.901633 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:09.901886 (+ 253us) client_negotiation.cc:769] Sending connection context
0810 03:46:09.902088 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 03:46:09.902446 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":127,"threads_started":1}
I20260810 03:46:09.906028 2285 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42721
I20260810 03:46:09.906291 2285 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:46:09.906840 2285 heartbeater.cc:511] Master 127.22.134.254:42721 requested a full tablet report, sending...
I20260810 03:46:09.907961 1921 ts_manager.cc:194] Registered new tserver with Master: 34dac973be8f41d982fedf57980e8494 (127.22.134.194:35109)
I20260810 03:46:09.908569 1921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:56783
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:46:09.929165 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42721
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:34983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:46:10.057929 2290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:10.058275 2290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:10.058368 2290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:10.063387 2290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:10.063493 2290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:10.063601 2290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:46:10.069924 2290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:34983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:10.071182 2290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:10.072386 2290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:10.083472 2299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:10.083491 2297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:10.083489 2296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:10.083772 2290 server_base.cc:1034] running on GCE node
I20260810 03:46:10.084343 2290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:10.085143 2290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:10.086326 2290 hybrid_clock.cc:648] HybridClock initialized: now 1786333570086310 us; error 40 us; skew 500 ppm
Aug 10 03:46:10 dist-test-slave-qg60 krb5kdc[1871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333570, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:46:10.089444 2290 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:46:10.090494 2290 webserver.cc:460] Webserver started at http://127.22.134.195:39719/ using document root <none> and password file <none>
I20260810 03:46:10.091105 2290 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:10.091174 2290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:10.091431 2290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:46:10.093708 2290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "c6bacbf4cbc547fc9796c5b309494c09"
format_stamp: "Formatted at 2026-08-10 03:46:10 on dist-test-slave-qg60"
server_key: "edf55feaabbaf94c33836fdfd33a8023"
server_key_iv: "abf48d5fe0e8a2caa78d20fe2e9bb08e"
server_key_version: "encryptionkey@0"
I20260810 03:46:10.094313 2290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "c6bacbf4cbc547fc9796c5b309494c09"
format_stamp: "Formatted at 2026-08-10 03:46:10 on dist-test-slave-qg60"
server_key: "edf55feaabbaf94c33836fdfd33a8023"
server_key_iv: "abf48d5fe0e8a2caa78d20fe2e9bb08e"
server_key_version: "encryptionkey@0"
I20260810 03:46:10.098418 2290 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:46:10.101140 2308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:10.102507 2290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:46:10.102689 2290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "c6bacbf4cbc547fc9796c5b309494c09"
format_stamp: "Formatted at 2026-08-10 03:46:10 on dist-test-slave-qg60"
server_key: "edf55feaabbaf94c33836fdfd33a8023"
server_key_iv: "abf48d5fe0e8a2caa78d20fe2e9bb08e"
server_key_version: "encryptionkey@0"
I20260810 03:46:10.102823 2290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:10.115868 2290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:10.119248 2290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:10.119459 2290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:10.120080 2290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:46:10.121042 2290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:46:10.121114 2290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:10.121186 2290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:46:10.121236 2290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:10.130949 2290 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:41575
I20260810 03:46:10.130976 2435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:41575 every 8 connection(s)
I20260810 03:46:10.132018 2290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:46:10.138078 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 2290
I20260810 03:46:10.138211 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:46:10.138521 23067 external_mini_cluster.cc:1428] Setting key c7df75c08190d36619a945f5f910aa09
Aug 10 03:46:10 dist-test-slave-qg60 krb5kdc[1871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333570, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:46:10.147055 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.134232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:39169 (local address 127.22.134.254:42721)
0810 03:46:10.134382 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:10.134393 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:10.135085 (+ 692us) server_negotiation.cc:407] Connection header received
0810 03:46:10.136584 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:10.136588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:10.136652 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:10.136758 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:10.138062 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.138797 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.140278 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.140491 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.140649 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.143412 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:10.143415 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:10.143417 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:46:10.143443 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:10.144957 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:10.145507 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:10.145509 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:10.145510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:10.145582 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:10.145945 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:10.145949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:10.145950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:10.146180 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:10.146283 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:10.146813 (+ 530us) server_negotiation.cc:299] Negotiation successful
0810 03:46:10.146922 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:46:10.147924 2438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.134381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42721 (local address 127.22.134.195:39169)
0810 03:46:10.134904 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:10.134951 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:10.136359 (+ 1408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:10.136931 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:10.136938 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:10.137322 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:46:10.137869 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.137890 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.138971 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.138974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.140154 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.140165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.140706 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.140711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.140932 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.141684 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:46:10.141701 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:46:10.143226 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:46:10.145120 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:46:10.145125 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:46:10.145137 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:46:10.145416 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:46:10.145688 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:46:10.145690 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:46:10.145692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:46:10.145828 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:46:10.146316 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:46:10.146321 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:46:10.146564 (+ 243us) client_negotiation.cc:769] Sending connection context
0810 03:46:10.146743 (+ 179us) client_negotiation.cc:240] Negotiation successful
0810 03:46:10.147011 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":129,"threads_started":1}
I20260810 03:46:10.149168 2436 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42721
I20260810 03:46:10.149444 2436 heartbeater.cc:464] Registering TS with master...
I20260810 03:46:10.149976 2436 heartbeater.cc:511] Master 127.22.134.254:42721 requested a full tablet report, sending...
I20260810 03:46:10.151059 1921 ts_manager.cc:194] Registered new tserver with Master: c6bacbf4cbc547fc9796c5b309494c09 (127.22.134.195:41575)
I20260810 03:46:10.151769 1921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:39169
I20260810 03:46:10.152594 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:46:10.163466 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.154792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41538 (local address 127.22.134.254:42721)
0810 03:46:10.154963 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:10.154966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:10.155145 (+ 179us) server_negotiation.cc:407] Connection header received
0810 03:46:10.155215 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:10.155217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:10.155261 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:10.155346 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:10.156175 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.156904 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.157799 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.158140 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.158252 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.159860 (+ 1608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:10.159867 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:10.159874 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:46:10.159900 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:10.161576 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:10.162051 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:10.162055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:10.162056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:10.162154 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:10.162458 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:10.162462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:10.162464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:10.162712 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:10.162885 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:10.163158 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 03:46:10.163284 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260810 03:46:10.166586 1921 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41538:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:46:10.169764 1921 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:46:10.185293 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.179128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:44899 (local address 127.0.0.1:51158)
0810 03:46:10.180285 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:10.180295 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:10.180407 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:10.180874 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:10.180879 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:10.180901 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:46:10.181005 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.181011 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.182376 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.182379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.183611 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.183620 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.184661 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.184668 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.184823 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.184869 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 03:46:10.184987 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 03:46:10.185114 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1095,"mutex_wait_us":134,"thread_start_us":86,"threads_started":1}
I20260810 03:46:10.185449 2450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.178795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:41575 (local address 127.0.0.1:45358)
0810 03:46:10.179847 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:10.179905 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:10.180051 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:10.181085 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:10.181088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:10.181105 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:46:10.181202 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.181210 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.182377 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.182379 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.183877 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.183885 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.184963 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.184969 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.185065 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.185086 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 03:46:10.185167 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 03:46:10.185235 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":862,"mutex_wait_us":80,"thread_start_us":97,"threads_started":1}
I20260810 03:46:10.185628 2447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.178823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:35109 (local address 127.0.0.1:55666)
0810 03:46:10.179992 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:10.180008 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:10.180108 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:10.180582 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:10.180588 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:10.180610 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:46:10.180797 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.180805 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.182302 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.182306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.183852 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.183863 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.184913 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.184918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.185005 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.185028 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:46:10.185117 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 03:46:10.185212 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1102,"mutex_wait_us":97,"thread_start_us":110,"threads_started":1}
I20260810 03:46:10.185621 2451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.179409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55666 (local address 127.22.134.194:35109)
0810 03:46:10.179855 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:10.179873 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:10.180090 (+ 217us) server_negotiation.cc:407] Connection header received
0810 03:46:10.180256 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:10.180261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:10.180423 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:10.180581 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:46:10.180951 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.182165 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.184005 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.184607 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.184730 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.184881 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:10.185362 (+ 481us) server_negotiation.cc:299] Negotiation successful
0810 03:46:10.185468 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":118,"threads_started":1}
I20260810 03:46:10.186153 2452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.179613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.22.134.193:44899)
0810 03:46:10.179993 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:10.180000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:10.180392 (+ 392us) server_negotiation.cc:407] Connection header received
0810 03:46:10.180517 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:10.180531 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:10.180714 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:10.180881 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:46:10.181138 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.182233 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.183744 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.184518 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.184653 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.184825 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:10.185895 (+ 1070us) server_negotiation.cc:299] Negotiation successful
0810 03:46:10.186011 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":98,"threads_started":1}
I20260810 03:46:10.186312 2449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.178911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45358 (local address 127.22.134.195:41575)
0810 03:46:10.180658 (+ 1747us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:10.180669 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:10.180691 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:46:10.180781 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:10.180790 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:10.180954 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:10.181103 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:46:10.181335 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.182090 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.183996 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.184815 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.184969 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.185094 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:10.185202 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 03:46:10.185306 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1647,"thread_start_us":95,"threads_started":1}
I20260810 03:46:10.188882 2365 tablet_service.cc:1467] Processing CreateTablet for tablet 86818d3c7ad44646b30fdda80820573f (DEFAULT_TABLE table=test-table [id=aec9a568be3b46e7b715698bd3cb60eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:46:10.188884 2067 tablet_service.cc:1467] Processing CreateTablet for tablet 86818d3c7ad44646b30fdda80820573f (DEFAULT_TABLE table=test-table [id=aec9a568be3b46e7b715698bd3cb60eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:46:10.188885 2214 tablet_service.cc:1467] Processing CreateTablet for tablet 86818d3c7ad44646b30fdda80820573f (DEFAULT_TABLE table=test-table [id=aec9a568be3b46e7b715698bd3cb60eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:46:10.189985 2365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86818d3c7ad44646b30fdda80820573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:46:10.189986 2214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86818d3c7ad44646b30fdda80820573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:46:10.189986 2067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86818d3c7ad44646b30fdda80820573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:46:10.196973 2453 tablet_bootstrap.cc:492] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: Bootstrap starting.
I20260810 03:46:10.198128 2454 tablet_bootstrap.cc:492] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa: Bootstrap starting.
I20260810 03:46:10.199640 2453 tablet_bootstrap.cc:654] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: Neither blocks nor log segments found. Creating new log.
I20260810 03:46:10.199890 2454 tablet_bootstrap.cc:654] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa: Neither blocks nor log segments found. Creating new log.
I20260810 03:46:10.200464 2453 log.cc:824] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: Log is configured to *not* fsync() on all Append() calls
I20260810 03:46:10.200570 2454 log.cc:824] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa: Log is configured to *not* fsync() on all Append() calls
I20260810 03:46:10.201134 2455 tablet_bootstrap.cc:492] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: Bootstrap starting.
I20260810 03:46:10.202809 2453 tablet_bootstrap.cc:492] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: No bootstrap required, opened a new log
I20260810 03:46:10.202901 2454 tablet_bootstrap.cc:492] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa: No bootstrap required, opened a new log
I20260810 03:46:10.203034 2453 ts_tablet_manager.cc:1397] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:46:10.203091 2454 ts_tablet_manager.cc:1397] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 03:46:10.203749 2455 tablet_bootstrap.cc:654] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: Neither blocks nor log segments found. Creating new log.
I20260810 03:46:10.204769 2455 log.cc:824] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: Log is configured to *not* fsync() on all Append() calls
I20260810 03:46:10.206844 2453 raft_consensus.cc:348] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.207108 2453 raft_consensus.cc:374] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:46:10.207166 2453 raft_consensus.cc:729] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6bacbf4cbc547fc9796c5b309494c09, State: Initialized, Role: FOLLOWER
I20260810 03:46:10.207261 2455 tablet_bootstrap.cc:492] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: No bootstrap required, opened a new log
I20260810 03:46:10.207576 2455 ts_tablet_manager.cc:1397] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:46:10.207628 2453 consensus_queue.cc:260] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.207644 2454 raft_consensus.cc:348] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.207899 2454 raft_consensus.cc:374] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:46:10.207959 2454 raft_consensus.cc:729] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34b9693f6024f9094611518bfd3e5aa, State: Initialized, Role: FOLLOWER
I20260810 03:46:10.208370 2454 consensus_queue.cc:260] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.208694 2453 ts_tablet_manager.cc:1428] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260810 03:46:10.209110 2436 heartbeater.cc:503] Master 127.22.134.254:42721 was elected leader, sending a full tablet report...
I20260810 03:46:10.209369 2454 ts_tablet_manager.cc:1428] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 03:46:10.209690 2138 heartbeater.cc:503] Master 127.22.134.254:42721 was elected leader, sending a full tablet report...
I20260810 03:46:10.211443 2455 raft_consensus.cc:348] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.211637 2455 raft_consensus.cc:374] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:46:10.211715 2455 raft_consensus.cc:729] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34dac973be8f41d982fedf57980e8494, State: Initialized, Role: FOLLOWER
I20260810 03:46:10.212190 2455 consensus_queue.cc:260] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.213200 2455 ts_tablet_manager.cc:1428] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:46:10.213536 2285 heartbeater.cc:503] Master 127.22.134.254:42721 was elected leader, sending a full tablet report...
I20260810 03:46:10.295949 2463 raft_consensus.cc:482] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:46:10.296286 2463 raft_consensus.cc:504] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.297713 2463 leader_election.cc:288] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6bacbf4cbc547fc9796c5b309494c09 (127.22.134.195:41575), e34b9693f6024f9094611518bfd3e5aa (127.22.134.193:44899)
I20260810 03:46:10.302634 2287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.298032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:44899 (local address 127.22.134.194:52237)
0810 03:46:10.298207 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:10.298225 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:10.298337 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:10.298667 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:10.298671 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:10.298694 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:46:10.298835 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.298846 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.299806 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.299810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.301092 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.301108 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.302112 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.302115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.302202 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.302266 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 03:46:10.302346 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:46:10.302425 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260810 03:46:10.302697 2452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.298239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:52237 (local address 127.22.134.193:44899)
0810 03:46:10.298405 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:10.298409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:10.298424 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:46:10.298485 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:10.298488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:10.298533 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:10.298649 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:46:10.298982 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.299657 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.301222 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.301958 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.302111 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.302175 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:10.302448 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 03:46:10.302545 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 03:46:10.302762 2449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.298116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:59565 (local address 127.22.134.195:41575)
0810 03:46:10.298257 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:10.298261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:10.298818 (+ 557us) server_negotiation.cc:407] Connection header received
0810 03:46:10.298887 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:10.298893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:10.298962 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:10.299045 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:46:10.299358 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.300053 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.301454 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.302151 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.302304 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.302362 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:10.302547 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 03:46:10.302627 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:46:10.303125 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.298037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:41575 (local address 127.22.134.194:59565)
0810 03:46:10.298710 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:10.298723 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:46:10.298810 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:46:10.299077 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:46:10.299080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:46:10.299099 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:46:10.299225 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.299232 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.300181 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.300184 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.301309 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:46:10.301319 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.302292 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.302298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:46:10.302400 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.302419 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 03:46:10.302907 (+ 488us) client_negotiation.cc:240] Negotiation successful
0810 03:46:10.302991 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":268,"thread_start_us":164,"threads_started":1}
I20260810 03:46:10.303699 2089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86818d3c7ad44646b30fdda80820573f" candidate_uuid: "34dac973be8f41d982fedf57980e8494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34b9693f6024f9094611518bfd3e5aa" is_pre_election: true
I20260810 03:46:10.303853 2387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86818d3c7ad44646b30fdda80820573f" candidate_uuid: "34dac973be8f41d982fedf57980e8494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6bacbf4cbc547fc9796c5b309494c09" is_pre_election: true
I20260810 03:46:10.304108 2089 raft_consensus.cc:2454] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34dac973be8f41d982fedf57980e8494 in term 0.
I20260810 03:46:10.304291 2387 raft_consensus.cc:2454] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34dac973be8f41d982fedf57980e8494 in term 0.
I20260810 03:46:10.304716 2163 leader_election.cc:302] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34dac973be8f41d982fedf57980e8494, e34b9693f6024f9094611518bfd3e5aa; no voters:
I20260810 03:46:10.305087 2463 raft_consensus.cc:2781] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:46:10.305183 2463 raft_consensus.cc:482] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:46:10.305239 2463 raft_consensus.cc:3037] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:46:10.306473 2463 raft_consensus.cc:504] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.306943 2463 leader_election.cc:288] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [CANDIDATE]: Term 1 election: Requested vote from peers c6bacbf4cbc547fc9796c5b309494c09 (127.22.134.195:41575), e34b9693f6024f9094611518bfd3e5aa (127.22.134.193:44899)
I20260810 03:46:10.307485 2387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86818d3c7ad44646b30fdda80820573f" candidate_uuid: "34dac973be8f41d982fedf57980e8494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6bacbf4cbc547fc9796c5b309494c09"
I20260810 03:46:10.307633 2387 raft_consensus.cc:3037] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:46:10.308917 2387 raft_consensus.cc:2454] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34dac973be8f41d982fedf57980e8494 in term 1.
I20260810 03:46:10.308955 2089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86818d3c7ad44646b30fdda80820573f" candidate_uuid: "34dac973be8f41d982fedf57980e8494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34b9693f6024f9094611518bfd3e5aa"
I20260810 03:46:10.309180 2089 raft_consensus.cc:3037] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:46:10.309412 2161 leader_election.cc:302] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34dac973be8f41d982fedf57980e8494, c6bacbf4cbc547fc9796c5b309494c09; no voters:
I20260810 03:46:10.309652 2463 raft_consensus.cc:2781] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:46:10.309913 2463 raft_consensus.cc:686] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 1 LEADER]: Becoming Leader. State: Replica: 34dac973be8f41d982fedf57980e8494, State: Running, Role: LEADER
I20260810 03:46:10.310344 2463 consensus_queue.cc:237] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } }
I20260810 03:46:10.310652 2089 raft_consensus.cc:2454] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34dac973be8f41d982fedf57980e8494 in term 1.
I20260810 03:46:10.313961 1921 catalog_manager.cc:5495] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34dac973be8f41d982fedf57980e8494 (127.22.134.194). New cstate: current_term: 1 leader_uuid: "34dac973be8f41d982fedf57980e8494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34dac973be8f41d982fedf57980e8494" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 35109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 } health_report { overall_health: UNKNOWN } } }
I20260810 03:46:10.341581 2451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.337786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55668 (local address 127.22.134.194:35109)
0810 03:46:10.337941 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:10.337946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:10.337974 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:46:10.338069 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:10.338071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:10.338129 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:10.338270 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:46:10.338546 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.339068 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.339969 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:10.340220 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:10.340338 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:10.340673 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:46:10.341135 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:46:10.341288 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:10.341337 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 03:46:10.341399 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:46:10.348016 2387 raft_consensus.cc:1261] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 1 FOLLOWER]: Refusing update from remote peer 34dac973be8f41d982fedf57980e8494: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:46:10.348016 2089 raft_consensus.cc:1261] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa [term 1 FOLLOWER]: Refusing update from remote peer 34dac973be8f41d982fedf57980e8494: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:46:10.348929 2465 consensus_queue.cc:1035] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6bacbf4cbc547fc9796c5b309494c09" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:46:10.349290 2463 consensus_queue.cc:1035] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34b9693f6024f9094611518bfd3e5aa" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 44899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:46:10.368288 1921 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41538:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:46:10.368505 1921 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41538:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:46:10.371232 1921 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9812301c8cd64475b99e4f6349fb4522: Sending DeleteTablet for 3 replicas of tablet 86818d3c7ad44646b30fdda80820573f
I20260810 03:46:10.372256 2067 tablet_service.cc:1514] Processing DeleteTablet for tablet 86818d3c7ad44646b30fdda80820573f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:46:10 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:51158
I20260810 03:46:10.372254 2214 tablet_service.cc:1514] Processing DeleteTablet for tablet 86818d3c7ad44646b30fdda80820573f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:46:10 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:55666
I20260810 03:46:10.372843 2483 tablet_replica.cc:330] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: stopping tablet replica
I20260810 03:46:10.372869 2365 tablet_service.cc:1514] Processing DeleteTablet for tablet 86818d3c7ad44646b30fdda80820573f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:46:10 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:45358
I20260810 03:46:10.373206 2483 raft_consensus.cc:2229] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:46:10.373309 2486 tablet_replica.cc:330] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: stopping tablet replica
I20260810 03:46:10.373598 2486 raft_consensus.cc:2229] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:46:10.373663 2483 raft_consensus.cc:2258] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:46:10.373852 2485 tablet_replica.cc:330] T 86818d3c7ad44646b30fdda80820573f P e34b9693f6024f9094611518bfd3e5aa: stopping tablet replica
I20260810 03:46:10.374009 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 1995
I20260810 03:46:10.374081 2486 raft_consensus.cc:2258] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:46:10.376294 2486 ts_tablet_manager.cc:1905] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:46:10.377578 2483 ts_tablet_manager.cc:1905] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:46:10.378834 2486 ts_tablet_manager.cc:1918] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:46:10.378959 2486 log.cc:1196] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/86818d3c7ad44646b30fdda80820573f
I20260810 03:46:10.379271 2486 ts_tablet_manager.cc:1939] T 86818d3c7ad44646b30fdda80820573f P c6bacbf4cbc547fc9796c5b309494c09: Deleting consensus metadata
I20260810 03:46:10.380496 1905 catalog_manager.cc:4841] TS c6bacbf4cbc547fc9796c5b309494c09 (127.22.134.195:41575): tablet 86818d3c7ad44646b30fdda80820573f (table test-table [id=aec9a568be3b46e7b715698bd3cb60eb]) successfully deleted
I20260810 03:46:10.381258 2483 ts_tablet_manager.cc:1918] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:46:10.381377 2483 log.cc:1196] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/86818d3c7ad44646b30fdda80820573f
I20260810 03:46:10.381752 2483 ts_tablet_manager.cc:1939] T 86818d3c7ad44646b30fdda80820573f P 34dac973be8f41d982fedf57980e8494: Deleting consensus metadata
I20260810 03:46:10.383208 1908 catalog_manager.cc:4841] TS 34dac973be8f41d982fedf57980e8494 (127.22.134.194:35109): tablet 86818d3c7ad44646b30fdda80820573f (table test-table [id=aec9a568be3b46e7b715698bd3cb60eb]) successfully deleted
W20260810 03:46:10.384014 1907 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:44899 (error 108)
I20260810 03:46:10.385018 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 2143
I20260810 03:46:10.385255 2447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:10.384895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:44899 (local address 127.0.0.1:51170)
0810 03:46:10.385089 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 03:46:10.385168 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:44899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260810 03:46:10.388023 1907 catalog_manager.cc:4584] TS e34b9693f6024f9094611518bfd3e5aa (127.22.134.193:44899): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 86818d3c7ad44646b30fdda80820573f: Network error: Client connection negotiation failed: client connection to 127.22.134.193:44899: connect: Connection refused (error 111)
I20260810 03:46:10.394140 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 2290
I20260810 03:46:10.402031 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 1886
2026-08-10T03:46:10Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2509 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:46:10 dist-test-slave-qg60 krb5kdc[2492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:46:10 dist-test-slave-qg60 krb5kdc[2492](info): set up 2 sockets
Aug 10 03:46:10 dist-test-slave-qg60 krb5kdc[2492](info): commencing operation
krb5kdc: starting...
W20260810 03:46:11.548396 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:46:11 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:46:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:46:11Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.134.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.134.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/rangeradmin_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/rangeradmin_127.22.134.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.134.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.134.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/rangerlookup_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/rangerlookup_127.22.134.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.134.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.134.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/HTTP_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/HTTP_127.22.134.212@KRBTEST.COM.keytab.
I20260810 03:46:11.744079 23067 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWYy72V/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/postgres -l logfile start
2026-08-10 03:46:14.687 UTC [2526] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 03:46:14.687 UTC [2526] LOG: listening on IPv4 address "127.22.134.212", port 35617
2026-08-10 03:46:14.692 UTC [2526] LOG: listening on Unix socket "/tmp/.s.PGSQL.35617"
2026-08-10 03:46:14.715 UTC [2529] LOG: database system was shut down at 2026-08-10 03:46:12 UTC
2026-08-10 03:46:14.719 UTC [2526] LOG: database system is ready to accept connections
I20260810 03:46:15.785799 23067 mini_postgres.cc:96] Postgres bound to 35617
2026-08-10 03:46:15.795 UTC [2537] FATAL: database "slave" does not exist
127.22.134.212:35617 - accepting connections
I20260810 03:46:15.796452 23067 mini_ranger.cc:161] Starting Ranger...
I20260810 03:46:15.815263 23067 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 03:46:16.400995 23067 mini_ranger.cc:87] Created ranger Postgres database
I20260810 03:46:16.401100 23067 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-admin
2026-08-10 03:46:16,736 [I] DB FLAVOR :POSTGRES
2026-08-10 03:46:16,736 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 03:46:16,736 [I] Checking connection..
2026-08-10 03:46:16,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 03:46:17,020 [I] Checking connection passed.
2026-08-10 03:46:17,020 [I] --------- Verifying version history table ---------
2026-08-10 03:46:17,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:46:17,279 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 03:46:17,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:46:17,523 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 03:46:17,523 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 03:46:17,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 03:46:17.782 UTC [2608] WARNING: there is no transaction in progress
2026-08-10 03:46:17,789 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 03:46:17,789 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:46:18,042 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 03:46:18,042 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 03:46:18,042 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 03:46:18,321 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 03:46:18,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-qg60.c.gcp-upstream.internal','N') ;"
2026-08-10 03:46:18,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 03:46:19,112 [I] Table x_portal_user does not exist in database ranger
2026-08-10 03:46:19,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 03:46:19,359 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 03:46:19,359 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 03:46:19,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 03:46:19,924 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 03:46:19,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 03:46:20.959 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:20.977 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:20.994 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.011 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.028 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.047 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.106 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.113 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.128 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.139 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.150 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.165 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.176 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.183 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.191 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21.198 UTC [2727] WARNING: there is no transaction in progress
2026-08-10 03:46:21,905 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 03:46:21,905 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 03:46:22,178 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 03:46:22,178 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 03:46:22,447 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 03:46:22,447 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 03:46:22,713 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 03:46:22,713 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 03:46:22,978 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 03:46:23,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-qg60.c.gcp-upstream.internal';"
2026-08-10 03:46:23,494 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 03:46:23,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 03:46:23,744 [I] DB_PATCHES have already been applied
I20260810 03:46:23.750787 23067 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWYy72V/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 03:46:23.750916 23067 mini_ranger.cc:193] Using host: 127.22.134.212
I20260810 03:46:23.755471 23067 mini_ranger.cc:227] Ranger admin URL: http://127.22.134.212:51593
Aug 10, 2026 3:46:24 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:46:24 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:46:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 3:46:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 3:46:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 3:46:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 3:46:24 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 03:46:24.964565 23067 mini_ranger.cc:160] Time spent starting Ranger: real 9.168s user 0.001s sys 0.013s
Aug 10, 2026 3:46:47 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 3:46:47 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 3:46:47 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 3:46:47 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 3:46:48 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 03:46:49.599020 23067 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.134.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.134.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/rangerkms_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/rangerkms_127.22.134.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.134.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.134.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.134.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/HTTP_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.134.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/HTTP_127.22.134.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 03:46:49 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333609, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 03:46:49.698912 23067 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 03:46:49.710922 23067 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 03:46:50.759847 23067 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 03:46:50.759968 23067 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms
I20260810 03:46:50.760094 23067 mini_ranger_kms.cc:227] Using postgres at 127.22.134.212:35617
2026-08-10 03:46:51,319 [I] DB FLAVOR :POSTGRES
2026-08-10 03:46:51,319 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 03:46:51,319 [I] Checking connection
2026-08-10 03:46:51,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 03:46:51,639 [I] connection success
2026-08-10 03:46:51,639 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 03:46:51,639 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 03:46:51,639 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 03:46:51,909 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 03:46:51,909 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 03:46:51,909 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 03:46:51,909 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:35617/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 03:46:52,201 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 03:46:52.689847 23067 mini_ranger_kms.cc:310] Created kms service
I20260810 03:46:52.883338 23067 mini_ranger_kms.cc:326] Created kudu user
I20260810 03:46:52.933847 23067 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 03:46:52 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333609, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:46:53.402938 23067 mini_ranger_kms.cc:384] Added ranger policy
I20260810 03:46:53.403115 23067 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 03:46:53.403139 23067 mini_ranger_kms.cc:240] Using host: 127.22.134.212
I20260810 03:46:53.408386 23067 mini_ranger_kms.cc:276] Ranger KMS PID: 2934
I20260810 03:46:53.408526 23067 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.134.212:34601
Aug 10, 2026 3:46:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:46:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:46:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 3:46:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 3:46:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 3:46:55 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260810 03:46:55.846525 23067 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.148s user 0.036s sys 0.499s
I20260810 03:46:55.846674 23067 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 03:46:55.846808 23067 mini_ranger_kms.cc:401] 127.22.134.212:34601/kms/v1/keys
Aug 10 03:46:55 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786333615, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.134.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 03:46:56 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333615, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.134.212@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
Aug 10 03:46:56 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333615, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.134.212@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
Aug 10 03:46:59 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:46:59.432512 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:39331
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:39331
--ranger_config_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:34601/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:46:59.576337 2989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:46:59.576699 2989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:46:59.576823 2989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:46:59.581218 2989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:46:59.581284 2989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:46:59.581303 2989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:46:59.581321 2989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:46:59.581373 2989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:46:59.587131 2989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.134.212:34601/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:39331
--ranger_config_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:39331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:46:59.588323 2989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:46:59.589511 2989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:46:59.599823 2998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:59.599887 2995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:46:59.599926 2996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:46:59.600780 2989 server_base.cc:1034] running on GCE node
I20260810 03:46:59.601454 2989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:46:59.602892 2989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:46:59.604094 2989 hybrid_clock.cc:648] HybridClock initialized: now 1786333619604076 us; error 41 us; skew 500 ppm
Aug 10 03:46:59 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333619, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:46:59.613119 2989 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:46:59.614166 2989 webserver.cc:460] Webserver started at http://127.22.134.254:35531/ using document root <none> and password file <none>
I20260810 03:46:59.614740 2989 fs_manager.cc:359] Metadata directory not provided
I20260810 03:46:59.614823 2989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:46:59.615159 2989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:46:59 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333619, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:46:59.680477 2989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "38e88e660b1748b490cfce609d880775"
format_stamp: "Formatted at 2026-08-10 03:46:59 on dist-test-slave-qg60"
server_key: "154bc675d3299771d56ed759449b7539"
server_key_iv: "60bf184a554b4088f4b89fc3152e6269"
server_key_version: "kuduclusterkey@0"
I20260810 03:46:59.681212 2989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "38e88e660b1748b490cfce609d880775"
format_stamp: "Formatted at 2026-08-10 03:46:59 on dist-test-slave-qg60"
server_key: "154bc675d3299771d56ed759449b7539"
server_key_iv: "60bf184a554b4088f4b89fc3152e6269"
server_key_version: "kuduclusterkey@0"
I20260810 03:46:59.685637 2989 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:46:59.703269 3006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:46:59.705049 2989 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:46:59.705220 2989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "38e88e660b1748b490cfce609d880775"
format_stamp: "Formatted at 2026-08-10 03:46:59 on dist-test-slave-qg60"
server_key: "154bc675d3299771d56ed759449b7539"
server_key_iv: "60bf184a554b4088f4b89fc3152e6269"
server_key_version: "kuduclusterkey@0"
I20260810 03:46:59.705447 2989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:46:59.721947 2989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:46:59.725476 2989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:46:59.725742 2989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:46:59.734303 2989 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:39331
I20260810 03:46:59.734369 3062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:39331 every 8 connection(s)
I20260810 03:46:59.735335 2989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:46:59.738356 3063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:46:59.743400 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 2989
I20260810 03:46:59.743577 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:46:59.744031 23067 external_mini_cluster.cc:1428] Setting key 3f61ec5ff903bd5bff44fd736eb15f13
I20260810 03:46:59.744194 3063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775: Bootstrap starting.
I20260810 03:46:59.747098 3063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775: Neither blocks nor log segments found. Creating new log.
I20260810 03:46:59.748011 3063 log.cc:824] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775: Log is configured to *not* fsync() on all Append() calls
I20260810 03:46:59.750463 3063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775: No bootstrap required, opened a new log
Aug 10 03:46:59 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:46:59.755349 3063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e88e660b1748b490cfce609d880775" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39331 } }
I20260810 03:46:59.755664 3063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:46:59.755769 3063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e88e660b1748b490cfce609d880775, State: Initialized, Role: FOLLOWER
I20260810 03:46:59.756307 3063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e88e660b1748b490cfce609d880775" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39331 } }
I20260810 03:46:59.756476 3063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:46:59.756589 3063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:46:59.756717 3063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:46:59.758024 3063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e88e660b1748b490cfce609d880775" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39331 } }
I20260810 03:46:59.758455 3063 leader_election.cc:302] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38e88e660b1748b490cfce609d880775; no voters:
I20260810 03:46:59.758862 3063 leader_election.cc:288] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:46:59.759025 3068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:46:59.759316 3068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [term 1 LEADER]: Becoming Leader. State: Replica: 38e88e660b1748b490cfce609d880775, State: Running, Role: LEADER
I20260810 03:46:59.759675 3068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e88e660b1748b490cfce609d880775" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39331 } }
I20260810 03:46:59.759835 3066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:46:59.745510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59938 (local address 127.22.134.254:39331)
0810 03:46:59.746002 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0810 03:46:59.746021 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 03:46:59.746064 (+ 43us) server_negotiation.cc:407] Connection header received
0810 03:46:59.746856 (+ 792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:46:59.746879 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:46:59.747301 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:46:59.747687 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:46:59.748820 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:59.749858 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:59.750988 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:46:59.751477 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:46:59.751655 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:46:59.754323 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:46:59.754328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:46:59.754343 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:46:59.754372 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:46:59.756258 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:59.756877 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:59.756883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:59.756887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:59.756992 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:46:59.757304 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:46:59.757312 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:46:59.757313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:46:59.757735 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:46:59.757955 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0810 03:46:59.758281 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 03:46:59.758752 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":144,"threads_started":1}
I20260810 03:46:59.760313 3063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:46:59.760993 3068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38e88e660b1748b490cfce609d880775" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e88e660b1748b490cfce609d880775" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39331 } } }
I20260810 03:46:59.761206 3068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [sys.catalog]: This master's current role is: LEADER
I20260810 03:46:59.761492 3068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38e88e660b1748b490cfce609d880775. Latest consensus state: current_term: 1 leader_uuid: "38e88e660b1748b490cfce609d880775" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e88e660b1748b490cfce609d880775" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39331 } } }
I20260810 03:46:59.761626 3068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775 [sys.catalog]: This master's current role is: LEADER
I20260810 03:46:59.762892 3063 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 03:46:59.763304 3078 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:46:59.772229 3078 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:46:59.782609 3078 catalog_manager.cc:1347] Generated new cluster ID: 96a491f704544b4a8e5c567fdafb4d25
I20260810 03:46:59.782694 3078 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:46:59.807343 3078 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:46:59.808943 3078 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:46:59.816454 3078 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775: Generated new TSK 0
I20260810 03:46:59.817382 3078 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:47:00.664615 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:34601/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:39331
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:47:00.870116 3114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:00.870573 3114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:00.870649 3114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:00.878211 3114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:00.878312 3114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:00.878420 3114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:47:00.886951 3114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.134.212:34601/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:39331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:00.888417 3114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:00.889854 3114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:00.902546 3124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:00.902683 3121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:00.902556 3122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:00.903785 3114 server_base.cc:1034] running on GCE node
I20260810 03:47:00.904369 3114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:00.905457 3114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:00.906684 3114 hybrid_clock.cc:648] HybridClock initialized: now 1786333620906661 us; error 41 us; skew 500 ppm
Aug 10 03:47:00 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333620, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:00.911541 3114 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:47:00.913029 3114 webserver.cc:460] Webserver started at http://127.22.134.193:41669/ using document root <none> and password file <none>
I20260810 03:47:00.913985 3114 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:00.914144 3114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:00.914520 3114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:47:00 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333620, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:00.938709 3114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "b85cea1f26784a2999d5bbaea2fdb8b7"
format_stamp: "Formatted at 2026-08-10 03:47:00 on dist-test-slave-qg60"
server_key: "d304c8fb0a694054381cd7725ba7df42"
server_key_iv: "4ff0634c8cf383d4f0096dabead8d17d"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:00.940585 3114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "b85cea1f26784a2999d5bbaea2fdb8b7"
format_stamp: "Formatted at 2026-08-10 03:47:00 on dist-test-slave-qg60"
server_key: "d304c8fb0a694054381cd7725ba7df42"
server_key_iv: "4ff0634c8cf383d4f0096dabead8d17d"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:00.947669 3114 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260810 03:47:00.963435 3133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:00.965009 3114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:47:00.965161 3114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "b85cea1f26784a2999d5bbaea2fdb8b7"
format_stamp: "Formatted at 2026-08-10 03:47:00 on dist-test-slave-qg60"
server_key: "d304c8fb0a694054381cd7725ba7df42"
server_key_iv: "4ff0634c8cf383d4f0096dabead8d17d"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:00.965322 3114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:00.992821 3114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:00.996670 3114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:00.996917 3114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:00.997641 3114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:00.998739 3114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:00.998804 3114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:00.998865 3114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:00.998891 3114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:01.015780 3114 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:40725
I20260810 03:47:01.017120 3114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:47:01.019374 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 3114
I20260810 03:47:01.019518 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:47:01.019867 23067 external_mini_cluster.cc:1428] Setting key f92ee2d120436a7e1236fd58718df568
I20260810 03:47:01.030359 3259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:40725 every 8 connection(s)
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333620, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:01.066295 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.034638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:55803 (local address 127.22.134.254:39331)
0810 03:47:01.034978 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:01.034985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:01.041641 (+ 6656us) server_negotiation.cc:407] Connection header received
0810 03:47:01.047194 (+ 5553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:01.047199 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:01.047285 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:01.047366 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:01.049686 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.050680 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.052698 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.053129 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.053226 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.060830 (+ 7604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:01.060835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:01.060839 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:01.060876 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:01.063093 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:01.063927 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:01.063931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:01.063933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:01.064061 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:01.064578 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:01.064583 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:01.064585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:01.064946 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:01.065072 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:01.065905 (+ 833us) server_negotiation.cc:299] Negotiation successful
0810 03:47:01.066080 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":91,"threads_started":1}
I20260810 03:47:01.068534 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.033202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:39331 (local address 127.22.134.193:55803)
0810 03:47:01.041337 (+ 8135us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:01.041452 (+ 115us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:01.043861 (+ 2409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:01.047958 (+ 4097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:01.047971 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:01.048439 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:01.049452 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.049476 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.050867 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.050871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.052521 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.052534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.053492 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.053497 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.053753 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.058200 (+ 4447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:01.058229 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:01.060472 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:01.063279 (+ 2807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:01.063287 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:01.063310 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:01.063770 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:01.064202 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:01.064206 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:01.064208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:01.064438 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:01.065156 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:01.065165 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:01.065561 (+ 396us) client_negotiation.cc:769] Sending connection context
0810 03:47:01.066856 (+ 1295us) client_negotiation.cc:240] Negotiation successful
0810 03:47:01.067295 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7716,"thread_start_us":216,"threads_started":1}
I20260810 03:47:01.076683 3260 heartbeater.cc:347] Connected to a master server at 127.22.134.254:39331
I20260810 03:47:01.077021 3260 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:01.077728 3260 heartbeater.cc:511] Master 127.22.134.254:39331 requested a full tablet report, sending...
I20260810 03:47:01.079818 3023 ts_manager.cc:194] Registered new tserver with Master: b85cea1f26784a2999d5bbaea2fdb8b7 (127.22.134.193:40725)
I20260810 03:47:01.081686 3023 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:55803
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:47:01.098125 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:34601/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:39331
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 03:47:01.247984 3268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:01.248411 3268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:01.248482 3268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:01.253226 3268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:01.253296 3268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:01.253358 3268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:47:01.259709 3268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.134.212:34601/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:39331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:01.261073 3268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:01.262372 3268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:01.275040 3274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:01.274953 3275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:01.276763 3277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:01.276865 3268 server_base.cc:1034] running on GCE node
I20260810 03:47:01.277386 3268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:01.278203 3268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:01.279402 3268 hybrid_clock.cc:648] HybridClock initialized: now 1786333621279379 us; error 43 us; skew 500 ppm
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:01.282998 3268 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:47:01.284286 3268 webserver.cc:460] Webserver started at http://127.22.134.194:40933/ using document root <none> and password file <none>
I20260810 03:47:01.285193 3268 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:01.285302 3268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:01.285601 3268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:01.304486 3268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca"
format_stamp: "Formatted at 2026-08-10 03:47:01 on dist-test-slave-qg60"
server_key: "66dd6b304d11a790e045cf54c1ed5e9a"
server_key_iv: "f629568c81a2a632fa76b62c240b3493"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:01.305423 3268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca"
format_stamp: "Formatted at 2026-08-10 03:47:01 on dist-test-slave-qg60"
server_key: "66dd6b304d11a790e045cf54c1ed5e9a"
server_key_iv: "f629568c81a2a632fa76b62c240b3493"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:01.317464 3268 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.005s sys 0.000s
I20260810 03:47:01.336601 3285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:01.339166 3268 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260810 03:47:01.339413 3268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca"
format_stamp: "Formatted at 2026-08-10 03:47:01 on dist-test-slave-qg60"
server_key: "66dd6b304d11a790e045cf54c1ed5e9a"
server_key_iv: "f629568c81a2a632fa76b62c240b3493"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:01.339661 3268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:01.357752 3268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:01.361843 3268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:01.362221 3268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:01.363034 3268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:01.364216 3268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:01.364351 3268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:01.364459 3268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:01.364531 3268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:01.379295 3268 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:44651
I20260810 03:47:01.380600 3268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:47:01.382699 3409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:44651 every 8 connection(s)
I20260810 03:47:01.390318 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 3268
I20260810 03:47:01.390471 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:47:01.390858 23067 external_mini_cluster.cc:1428] Setting key 4cf7411a673b8dbaca6fe57eebc774b0
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:01.407982 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.384951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:37721 (local address 127.22.134.254:39331)
0810 03:47:01.385131 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:01.385136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:01.387705 (+ 2569us) server_negotiation.cc:407] Connection header received
0810 03:47:01.389030 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:01.389035 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:01.389096 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:01.389154 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:01.391117 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.391943 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.397602 (+ 5659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.397961 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.398061 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.401690 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:01.401694 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:01.401697 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:01.401726 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:01.403592 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:01.405934 (+ 2342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:01.405938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:01.405940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:01.406059 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:01.406528 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:01.406532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:01.406534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:01.406770 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:01.406860 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:01.407640 (+ 780us) server_negotiation.cc:299] Negotiation successful
0810 03:47:01.407792 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:47:01.410115 3412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.385807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:39331 (local address 127.22.134.194:37721)
0810 03:47:01.387523 (+ 1716us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:01.387581 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:01.388689 (+ 1108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:01.389580 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:01.389589 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:01.390009 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:01.390864 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.390885 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.395844 (+ 4959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.395849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.397448 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.397462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.398285 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.398289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.398508 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.399306 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:01.399327 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:01.401446 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:01.403752 (+ 2306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:01.403758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:01.403778 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:01.404172 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:01.406199 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:01.406202 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:01.406204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:01.406404 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:01.406930 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:01.406938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:01.407339 (+ 401us) client_negotiation.cc:769] Sending connection context
0810 03:47:01.408499 (+ 1160us) client_negotiation.cc:240] Negotiation successful
0810 03:47:01.408919 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1488,"thread_start_us":230,"threads_started":1}
I20260810 03:47:01.411856 3410 heartbeater.cc:347] Connected to a master server at 127.22.134.254:39331
I20260810 03:47:01.412132 3410 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:01.412748 3410 heartbeater.cc:511] Master 127.22.134.254:39331 requested a full tablet report, sending...
I20260810 03:47:01.413993 3023 ts_manager.cc:194] Registered new tserver with Master: 65d720d4c1c14b0faa2e3c5e3abd8eca (127.22.134.194:44651)
I20260810 03:47:01.414801 3023 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:37721
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:47:01.450137 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:34601/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:39331
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:35833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:47:01.652560 3416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:01.652974 3416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:01.653110 3416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:01.659230 3416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:01.659395 3416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:01.659538 3416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:47:01.667750 3416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:35833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.134.212:34601/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:39331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:01.669638 3416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:01.671271 3416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:01.685442 3421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:01.686040 3424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:01.686993 3416 server_base.cc:1034] running on GCE node
W20260810 03:47:01.687243 3422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:01.687776 3416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:01.688550 3416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:01.689839 3416 hybrid_clock.cc:648] HybridClock initialized: now 1786333621689766 us; error 92 us; skew 500 ppm
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:01.694478 3416 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:47:01.695626 3416 webserver.cc:460] Webserver started at http://127.22.134.195:34893/ using document root <none> and password file <none>
I20260810 03:47:01.696393 3416 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:01.696529 3416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:01.696842 3416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:01.717541 3416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "27843f0403af47869f7ab430af29c50c"
format_stamp: "Formatted at 2026-08-10 03:47:01 on dist-test-slave-qg60"
server_key: "d52461ee6dc3cd0c51e058efe085f2d6"
server_key_iv: "e0f7a6143f99fb93a85c8c38ef642df3"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:01.719477 3416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "27843f0403af47869f7ab430af29c50c"
format_stamp: "Formatted at 2026-08-10 03:47:01 on dist-test-slave-qg60"
server_key: "d52461ee6dc3cd0c51e058efe085f2d6"
server_key_iv: "e0f7a6143f99fb93a85c8c38ef642df3"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:01.725344 3416 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:01.753687 3432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:01.755393 3416 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:47:01.755532 3416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "27843f0403af47869f7ab430af29c50c"
format_stamp: "Formatted at 2026-08-10 03:47:01 on dist-test-slave-qg60"
server_key: "d52461ee6dc3cd0c51e058efe085f2d6"
server_key_iv: "e0f7a6143f99fb93a85c8c38ef642df3"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:01.755671 3416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:01.775154 3416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:01.787847 3416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:01.788187 3416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:01.789036 3416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:01.790167 3416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:01.790274 3416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:01.790369 3416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:01.790436 3416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:01.819057 3416 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:45409
I20260810 03:47:01.820447 3416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:47:01.825237 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 3416
I20260810 03:47:01.825402 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:47:01.825798 23067 external_mini_cluster.cc:1428] Setting key ff0e4bc447e9e7267bca72c5caafd8fc
I20260810 03:47:01.838419 3559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:45409 every 8 connection(s)
Aug 10 03:47:01 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:01.873847 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.837880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:52227 (local address 127.22.134.254:39331)
0810 03:47:01.838069 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:01.838074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:01.845728 (+ 7654us) server_negotiation.cc:407] Connection header received
0810 03:47:01.847994 (+ 2266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:01.847999 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:01.848079 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:01.848154 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:01.850343 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.851341 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.861923 (+ 10582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.862380 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.862516 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.868879 (+ 6363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:01.868884 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:01.868887 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:01.868922 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:01.871011 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:01.871806 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:01.871811 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:01.871813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:01.871908 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:01.872354 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:01.872358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:01.872360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:01.872627 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:01.872715 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:01.873509 (+ 794us) server_negotiation.cc:299] Negotiation successful
0810 03:47:01.873654 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:47:01.878015 3562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.836512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:39331 (local address 127.22.134.195:52227)
0810 03:47:01.845460 (+ 8948us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:01.845579 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:01.847166 (+ 1587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:01.848756 (+ 1590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:01.848770 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:01.849249 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:01.850087 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.850112 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.853586 (+ 3474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.853590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.855388 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.855405 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.862887 (+ 7482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.862894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.863221 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.866089 (+ 2868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:01.866115 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:01.868585 (+ 2470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:01.871202 (+ 2617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:01.871210 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:01.871233 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:01.871669 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:01.872025 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:01.872029 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:01.872031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:01.872236 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:01.872818 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:01.872825 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:01.873191 (+ 366us) client_negotiation.cc:769] Sending connection context
0810 03:47:01.874422 (+ 1231us) client_negotiation.cc:240] Negotiation successful
0810 03:47:01.874859 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8407,"thread_start_us":200,"threads_started":1}
I20260810 03:47:01.879776 3560 heartbeater.cc:347] Connected to a master server at 127.22.134.254:39331
I20260810 03:47:01.880038 3560 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:01.880648 3560 heartbeater.cc:511] Master 127.22.134.254:39331 requested a full tablet report, sending...
I20260810 03:47:01.881950 3023 ts_manager.cc:194] Registered new tserver with Master: 27843f0403af47869f7ab430af29c50c (127.22.134.195:45409)
I20260810 03:47:01.882643 3023 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:52227
I20260810 03:47:01.889315 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:47:01.900365 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.891765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59944 (local address 127.22.134.254:39331)
0810 03:47:01.891921 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:01.891934 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:01.892247 (+ 313us) server_negotiation.cc:407] Connection header received
0810 03:47:01.892381 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:01.892384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:01.892432 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:01.892528 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:01.893377 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.893991 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.895056 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.895299 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.895418 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.897011 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:01.897015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:01.897017 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:01.897053 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:01.898602 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:01.899062 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:01.899065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:01.899067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:01.899155 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:01.899452 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:01.899455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:01.899457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:01.899653 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:01.899804 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:01.900063 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 03:47:01.900196 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:47:01.903653 3023 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59944:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:47:01.907163 3023 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:47:01.926677 3574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.918973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:40725 (local address 127.0.0.1:54898)
0810 03:47:01.920861 (+ 1888us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:01.920873 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:01.920944 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:01.921591 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:01.921594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:01.921611 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:01.921714 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.921719 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.923097 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.923100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.924637 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.924649 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.926064 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.926067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.926198 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.926240 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 03:47:01.926357 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 03:47:01.926511 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1835,"mutex_wait_us":97,"thread_start_us":140,"threads_started":1}
I20260810 03:47:01.926841 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.919755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53006 (local address 127.22.134.195:45409)
0810 03:47:01.920376 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:01.920389 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:01.920691 (+ 302us) server_negotiation.cc:407] Connection header received
0810 03:47:01.920822 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:01.920828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:01.921024 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:01.921189 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:01.921646 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.922857 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.924876 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.925780 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.925907 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.926058 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:01.926537 (+ 479us) server_negotiation.cc:299] Negotiation successful
0810 03:47:01.926647 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":307,"threads_started":1}
I20260810 03:47:01.927196 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.918918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:45409 (local address 127.0.0.1:53006)
0810 03:47:01.920558 (+ 1640us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:01.920572 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:01.920674 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:01.921353 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:01.921356 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:01.921375 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:01.921498 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.921505 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.923012 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.923016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.924676 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.924687 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.926140 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.926144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.926273 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.926303 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 03:47:01.926427 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 03:47:01.927051 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1575,"mutex_wait_us":571,"thread_start_us":124,"threads_started":1}
I20260810 03:47:01.927491 3576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.919138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54898 (local address 127.22.134.193:40725)
0810 03:47:01.920413 (+ 1275us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:01.920420 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:01.921040 (+ 620us) server_negotiation.cc:407] Connection header received
0810 03:47:01.921160 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:01.921165 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:01.921328 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:01.921451 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:01.921833 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.922942 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.924825 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.925702 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.925805 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.925944 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:01.927203 (+ 1259us) server_negotiation.cc:299] Negotiation successful
0810 03:47:01.927348 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1170,"thread_start_us":134,"threads_started":1}
I20260810 03:47:01.928102 3573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.918627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:44651 (local address 127.0.0.1:35974)
0810 03:47:01.919910 (+ 1283us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:01.919965 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:01.920117 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:01.921037 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:01.921045 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:01.921074 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:01.921240 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.921248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.923792 (+ 2544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.923796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.925085 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:01.925095 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.927673 (+ 2578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.927679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:01.927857 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.927883 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:47:01.927942 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 03:47:01.928002 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1106,"mutex_wait_us":2,"thread_start_us":230,"threads_started":1}
I20260810 03:47:01.928879 3577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:01.919626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35974 (local address 127.22.134.194:44651)
0810 03:47:01.920274 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:01.920283 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:01.920310 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:47:01.920399 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:01.920406 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:01.920614 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:01.920845 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:01.921388 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.923640 (+ 2252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.925250 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:01.927523 (+ 2273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:01.928360 (+ 837us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:01.928533 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:01.928581 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 03:47:01.928658 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":91,"threads_started":1}
I20260810 03:47:01.930842 3186 tablet_service.cc:1467] Processing CreateTablet for tablet 98a678498b2d4c459f7f2c7d3c812bbb (DEFAULT_TABLE table=test-table [id=21e89c75bfb74e858ca1a381e5f9c631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:47:01.931892 3186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a678498b2d4c459f7f2c7d3c812bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:01.931705 3338 tablet_service.cc:1467] Processing CreateTablet for tablet 98a678498b2d4c459f7f2c7d3c812bbb (DEFAULT_TABLE table=test-table [id=21e89c75bfb74e858ca1a381e5f9c631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:47:01.932683 3338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a678498b2d4c459f7f2c7d3c812bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:01.937201 3488 tablet_service.cc:1467] Processing CreateTablet for tablet 98a678498b2d4c459f7f2c7d3c812bbb (DEFAULT_TABLE table=test-table [id=21e89c75bfb74e858ca1a381e5f9c631]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:47:01.938313 3488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98a678498b2d4c459f7f2c7d3c812bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:01.940587 3579 tablet_bootstrap.cc:492] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7: Bootstrap starting.
I20260810 03:47:01.941322 3580 tablet_bootstrap.cc:492] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Bootstrap starting.
I20260810 03:47:01.943156 3579 tablet_bootstrap.cc:654] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:01.944002 3580 tablet_bootstrap.cc:654] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:01.944197 3579 log.cc:824] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:01.945173 3580 log.cc:824] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:01.946736 3579 tablet_bootstrap.cc:492] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7: No bootstrap required, opened a new log
I20260810 03:47:01.946947 3579 ts_tablet_manager.cc:1397] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:47:01.947716 3580 tablet_bootstrap.cc:492] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: No bootstrap required, opened a new log
I20260810 03:47:01.947916 3580 ts_tablet_manager.cc:1397] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:47:01.952015 3579 raft_consensus.cc:348] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:01.952345 3579 raft_consensus.cc:374] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:01.952415 3579 raft_consensus.cc:729] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85cea1f26784a2999d5bbaea2fdb8b7, State: Initialized, Role: FOLLOWER
I20260810 03:47:01.953051 3579 consensus_queue.cc:260] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:01.952589 3580 raft_consensus.cc:348] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:01.953575 3580 raft_consensus.cc:374] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:01.953701 3580 raft_consensus.cc:729] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d720d4c1c14b0faa2e3c5e3abd8eca, State: Initialized, Role: FOLLOWER
I20260810 03:47:01.954319 3580 consensus_queue.cc:260] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:01.954489 3579 ts_tablet_manager.cc:1428] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:47:01.954948 3260 heartbeater.cc:503] Master 127.22.134.254:39331 was elected leader, sending a full tablet report...
I20260810 03:47:01.955508 3580 ts_tablet_manager.cc:1428] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 03:47:01.955881 3410 heartbeater.cc:503] Master 127.22.134.254:39331 was elected leader, sending a full tablet report...
I20260810 03:47:01.961125 3583 tablet_bootstrap.cc:492] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Bootstrap starting.
I20260810 03:47:01.964151 3583 tablet_bootstrap.cc:654] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:01.965086 3583 log.cc:824] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:01.967823 3583 tablet_bootstrap.cc:492] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: No bootstrap required, opened a new log
I20260810 03:47:01.968061 3583 ts_tablet_manager.cc:1397] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 03:47:01.972437 3583 raft_consensus.cc:348] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:01.972815 3583 raft_consensus.cc:374] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:01.972877 3583 raft_consensus.cc:729] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27843f0403af47869f7ab430af29c50c, State: Initialized, Role: FOLLOWER
I20260810 03:47:01.973440 3583 consensus_queue.cc:260] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:01.974349 3560 heartbeater.cc:503] Master 127.22.134.254:39331 was elected leader, sending a full tablet report...
I20260810 03:47:01.974644 3583 ts_tablet_manager.cc:1428] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260810 03:47:02.036083 3261 tablet.cc:2369] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:47:02.098214 3561 tablet.cc:2369] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 03:47:02 dist-test-slave-qg60 krb5kdc[2492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333621, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
W20260810 03:47:02.137933 3411 tablet.cc:2369] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:47:02.268316 3585 raft_consensus.cc:482] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:47:02.268678 3585 raft_consensus.cc:504] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:02.270169 3585 leader_election.cc:288] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27843f0403af47869f7ab430af29c50c (127.22.134.195:45409), b85cea1f26784a2999d5bbaea2fdb8b7 (127.22.134.193:40725)
I20260810 03:47:02.277562 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:02.270838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:44097 (local address 127.22.134.195:45409)
0810 03:47:02.271003 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:02.271009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:02.272879 (+ 1870us) server_negotiation.cc:407] Connection header received
0810 03:47:02.273115 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:02.273119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:02.273170 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:02.273218 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:02.273672 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.274438 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.276107 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.276802 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.276906 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:02.276962 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:02.277331 (+ 369us) server_negotiation.cc:299] Negotiation successful
0810 03:47:02.277416 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:47:02.278273 3591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:02.270401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:45409 (local address 127.22.134.194:44097)
0810 03:47:02.272717 (+ 2316us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:02.272771 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:02.272976 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:02.273363 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:02.273366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:02.273397 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:02.273547 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:02.273553 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.274611 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.274614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:02.275910 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:02.275922 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.277085 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.277088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:02.277186 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:02.277212 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:47:02.278031 (+ 819us) client_negotiation.cc:240] Negotiation successful
0810 03:47:02.278120 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2239,"thread_start_us":135,"threads_started":1}
I20260810 03:47:02.279156 3509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a678498b2d4c459f7f2c7d3c812bbb" candidate_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27843f0403af47869f7ab430af29c50c" is_pre_election: true
I20260810 03:47:02.279570 3509 raft_consensus.cc:2454] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d720d4c1c14b0faa2e3c5e3abd8eca in term 0.
I20260810 03:47:02.280157 3290 leader_election.cc:302] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27843f0403af47869f7ab430af29c50c, 65d720d4c1c14b0faa2e3c5e3abd8eca; no voters:
I20260810 03:47:02.280539 3585 raft_consensus.cc:2781] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:47:02.280622 3585 raft_consensus.cc:482] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:47:02.280663 3585 raft_consensus.cc:3037] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:02.282045 3585 raft_consensus.cc:504] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:02.282429 3585 leader_election.cc:288] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [CANDIDATE]: Term 1 election: Requested vote from peers 27843f0403af47869f7ab430af29c50c (127.22.134.195:45409), b85cea1f26784a2999d5bbaea2fdb8b7 (127.22.134.193:40725)
I20260810 03:47:02.283093 3509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a678498b2d4c459f7f2c7d3c812bbb" candidate_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27843f0403af47869f7ab430af29c50c"
I20260810 03:47:02.283224 3509 raft_consensus.cc:3037] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:02.284750 3509 raft_consensus.cc:2454] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d720d4c1c14b0faa2e3c5e3abd8eca in term 1.
I20260810 03:47:02.285132 3290 leader_election.cc:302] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27843f0403af47869f7ab430af29c50c, 65d720d4c1c14b0faa2e3c5e3abd8eca; no voters:
I20260810 03:47:02.285378 3585 raft_consensus.cc:2781] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:47:02.285606 3585 raft_consensus.cc:686] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 1 LEADER]: Becoming Leader. State: Replica: 65d720d4c1c14b0faa2e3c5e3abd8eca, State: Running, Role: LEADER
I20260810 03:47:02.285996 3585 consensus_queue.cc:237] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } }
I20260810 03:47:02.289810 3022 catalog_manager.cc:5495] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca reported cstate change: term changed from 0 to 1, leader changed from <none> to 65d720d4c1c14b0faa2e3c5e3abd8eca (127.22.134.194). New cstate: current_term: 1 leader_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 } health_report { overall_health: UNKNOWN } } }
I20260810 03:47:02.295434 3576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:02.271229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:53987 (local address 127.22.134.193:40725)
0810 03:47:02.271360 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:02.271364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:02.279037 (+ 7673us) server_negotiation.cc:407] Connection header received
0810 03:47:02.279299 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:02.279306 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:02.279369 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:02.279420 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:02.283137 (+ 3717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.283905 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.293985 (+ 10080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.294679 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.294786 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:02.294840 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:02.295197 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 03:47:02.295293 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:47:02.296072 3591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:02.271149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:40725 (local address 127.22.134.194:53987)
0810 03:47:02.278943 (+ 7794us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:02.278959 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:02.279117 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:02.279644 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:02.279648 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:02.279745 (+ 97us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:02.279824 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:02.279831 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.284129 (+ 4298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.284133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:02.293794 (+ 9661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:02.293810 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.294949 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.294953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:02.295047 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:02.295072 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:47:02.295840 (+ 768us) client_negotiation.cc:240] Negotiation successful
0810 03:47:02.295932 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7735,"thread_start_us":108,"threads_started":1}
I20260810 03:47:02.296950 3208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a678498b2d4c459f7f2c7d3c812bbb" candidate_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" is_pre_election: true
I20260810 03:47:02.297327 3208 raft_consensus.cc:2454] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d720d4c1c14b0faa2e3c5e3abd8eca in term 0.
I20260810 03:47:02.297700 3207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a678498b2d4c459f7f2c7d3c812bbb" candidate_uuid: "65d720d4c1c14b0faa2e3c5e3abd8eca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7"
I20260810 03:47:02.297827 3207 raft_consensus.cc:3037] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:02.299238 3207 raft_consensus.cc:2454] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65d720d4c1c14b0faa2e3c5e3abd8eca in term 1.
I20260810 03:47:02.394378 3577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:02.386884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35990 (local address 127.22.134.194:44651)
0810 03:47:02.387216 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:02.387221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:02.387679 (+ 458us) server_negotiation.cc:407] Connection header received
0810 03:47:02.387845 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:02.387848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:02.387904 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:02.387996 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:47:02.388443 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.389573 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.391088 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:02.391429 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:02.391543 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:02.393154 (+ 1611us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:47:02.393648 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:47:02.393753 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:02.394175 (+ 422us) server_negotiation.cc:299] Negotiation successful
0810 03:47:02.394237 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223}
I20260810 03:47:02.407658 3207 raft_consensus.cc:1261] T 98a678498b2d4c459f7f2c7d3c812bbb P b85cea1f26784a2999d5bbaea2fdb8b7 [term 1 FOLLOWER]: Refusing update from remote peer 65d720d4c1c14b0faa2e3c5e3abd8eca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:47:02.407658 3509 raft_consensus.cc:1261] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 1 FOLLOWER]: Refusing update from remote peer 65d720d4c1c14b0faa2e3c5e3abd8eca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:47:02.408461 3593 consensus_queue.cc:1035] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85cea1f26784a2999d5bbaea2fdb8b7" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:47:02.408661 3585 consensus_queue.cc:1035] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [LEADER]: Connected to new peer: Peer: permanent_uuid: "27843f0403af47869f7ab430af29c50c" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:47:02.422420 3596 mvcc.cc:205] Tried to move back new op lower bound from 7316822517372637184 to 7316822516886937600. Current Snapshot: MvccSnapshot[applied={T|T < 7316822517372637184}]
I20260810 03:47:02.427500 3598 mvcc.cc:205] Tried to move back new op lower bound from 7316822517372637184 to 7316822516886937600. Current Snapshot: MvccSnapshot[applied={T|T < 7316822517372637184}]
I20260810 03:47:02.442492 3022 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:47:02.442713 3022 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:47:02.445959 3022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38e88e660b1748b490cfce609d880775: Sending DeleteTablet for 3 replicas of tablet 98a678498b2d4c459f7f2c7d3c812bbb
I20260810 03:47:02.447044 3338 tablet_service.cc:1514] Processing DeleteTablet for tablet 98a678498b2d4c459f7f2c7d3c812bbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:47:02 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:35974
I20260810 03:47:02.447098 3488 tablet_service.cc:1514] Processing DeleteTablet for tablet 98a678498b2d4c459f7f2c7d3c812bbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:47:02 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:53006
I20260810 03:47:02.447611 3186 tablet_service.cc:1514] Processing DeleteTablet for tablet 98a678498b2d4c459f7f2c7d3c812bbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:47:02 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:54898
I20260810 03:47:02.450300 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 3114
I20260810 03:47:02.453035 3616 tablet_replica.cc:330] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: stopping tablet replica
I20260810 03:47:02.453424 3616 raft_consensus.cc:2229] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:47:02.453814 3616 raft_consensus.cc:2258] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:47:02.454248 3617 tablet_replica.cc:330] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: stopping tablet replica
I20260810 03:47:02.454571 3617 raft_consensus.cc:2229] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:47:02.455912 3617 raft_consensus.cc:2258] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:47:02.456422 3616 ts_tablet_manager.cc:1905] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:47:02.457532 3617 ts_tablet_manager.cc:1905] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:47:02.459625 3616 ts_tablet_manager.cc:1918] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:47:02.459743 3616 log.cc:1196] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/98a678498b2d4c459f7f2c7d3c812bbb
I20260810 03:47:02.460068 3616 ts_tablet_manager.cc:1939] T 98a678498b2d4c459f7f2c7d3c812bbb P 27843f0403af47869f7ab430af29c50c: Deleting consensus metadata
I20260810 03:47:02.461512 3009 catalog_manager.cc:4841] TS 27843f0403af47869f7ab430af29c50c (127.22.134.195:45409): tablet 98a678498b2d4c459f7f2c7d3c812bbb (table test-table [id=21e89c75bfb74e858ca1a381e5f9c631]) successfully deleted
I20260810 03:47:02.465054 3617 ts_tablet_manager.cc:1918] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:47:02.465184 3617 log.cc:1196] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/98a678498b2d4c459f7f2c7d3c812bbb
I20260810 03:47:02.465579 3617 ts_tablet_manager.cc:1939] T 98a678498b2d4c459f7f2c7d3c812bbb P 65d720d4c1c14b0faa2e3c5e3abd8eca: Deleting consensus metadata
I20260810 03:47:02.466936 3008 catalog_manager.cc:4841] TS 65d720d4c1c14b0faa2e3c5e3abd8eca (127.22.134.194:44651): tablet 98a678498b2d4c459f7f2c7d3c812bbb (table test-table [id=21e89c75bfb74e858ca1a381e5f9c631]) successfully deleted
W20260810 03:47:02.467551 3010 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:40725 (error 108)
I20260810 03:47:02.467856 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 3268
I20260810 03:47:02.470645 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:02.469806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:40725 (local address 127.0.0.1:54900)
0810 03:47:02.470447 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:02.470533 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":64,"threads_started":1}
W20260810 03:47:02.470897 3010 catalog_manager.cc:4584] TS b85cea1f26784a2999d5bbaea2fdb8b7 (127.22.134.193:40725): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 98a678498b2d4c459f7f2c7d3c812bbb: Network error: Client connection negotiation failed: client connection to 127.22.134.193:40725: connect: Connection refused (error 111)
I20260810 03:47:02.475476 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 3416
I20260810 03:47:02.484537 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 2989
I20260810 03:47:02.494410 23067 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 03:47:02.839634 23067 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 03:47:02.839779 23067 mini_ranger.cc:66] Stopping Ranger...
I20260810 03:47:03.185560 23067 mini_ranger.cc:68] Stopped Ranger
2026-08-10 03:47:03.185 UTC [2526] LOG: received smart shutdown request
2026-08-10 03:47:03.190 UTC [2526] LOG: background worker "logical replication launcher" (PID 2535) exited with exit code 1
2026-08-10 03:47:03.190 UTC [2530] LOG: shutting down
2026-08-10 03:47:03.383 UTC [2526] LOG: database system is shut down
2026-08-10T03:47:03Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53116 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:47:03 dist-test-slave-qg60 krb5kdc[3632](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:47:03 dist-test-slave-qg60 krb5kdc[3632](info): set up 2 sockets
Aug 10 03:47:03 dist-test-slave-qg60 krb5kdc[3632](info): commencing operation
krb5kdc: starting...
W20260810 03:47:04.655230 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:47:04 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:47:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:47:04Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.134.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.134.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/rangeradmin_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/rangeradmin_127.22.134.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.134.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.134.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/rangerlookup_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/rangerlookup_127.22.134.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.134.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.134.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/HTTP_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/HTTP_127.22.134.212@KRBTEST.COM.keytab.
I20260810 03:47:04.847486 23067 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWYy72V/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/postgres -l logfile start
2026-08-10 03:47:07.582 UTC [3665] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 03:47:07.582 UTC [3665] LOG: listening on IPv4 address "127.22.134.212", port 37667
2026-08-10 03:47:07.586 UTC [3665] LOG: listening on Unix socket "/tmp/.s.PGSQL.37667"
2026-08-10 03:47:07.609 UTC [3668] LOG: database system was shut down at 2026-08-10 03:47:05 UTC
2026-08-10 03:47:07.613 UTC [3665] LOG: database system is ready to accept connections
I20260810 03:47:08.663130 23067 mini_postgres.cc:96] Postgres bound to 37667
2026-08-10 03:47:08.670 UTC [3677] FATAL: database "slave" does not exist
127.22.134.212:37667 - accepting connections
I20260810 03:47:08.671396 23067 mini_ranger.cc:161] Starting Ranger...
I20260810 03:47:08.687855 23067 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 03:47:09.247025 23067 mini_ranger.cc:87] Created ranger Postgres database
I20260810 03:47:09.247126 23067 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-admin
2026-08-10 03:47:09,517 [I] DB FLAVOR :POSTGRES
2026-08-10 03:47:09,518 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 03:47:09,518 [I] Checking connection..
2026-08-10 03:47:09,518 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 03:47:09,780 [I] Checking connection passed.
2026-08-10 03:47:09,780 [I] --------- Verifying version history table ---------
2026-08-10 03:47:09,780 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:47:10,054 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 03:47:10,055 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:47:10,301 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 03:47:10,302 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 03:47:10,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 03:47:10.567 UTC [3750] WARNING: there is no transaction in progress
2026-08-10 03:47:10,575 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 03:47:10,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 03:47:10,833 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 03:47:10,834 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 03:47:10,834 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 03:47:11,082 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 03:47:11,342 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-qg60.c.gcp-upstream.internal','N') ;"
2026-08-10 03:47:11,611 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 03:47:11,849 [I] Table x_portal_user does not exist in database ranger
2026-08-10 03:47:11,849 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 03:47:12,106 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 03:47:12,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 03:47:12,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 03:47:12,653 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 03:47:12,654 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 03:47:13.694 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.712 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.731 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.747 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.764 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.783 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.842 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.849 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.865 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.876 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.888 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.904 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.914 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.922 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.931 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:13.940 UTC [3876] WARNING: there is no transaction in progress
2026-08-10 03:47:14,700 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 03:47:14,700 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 03:47:14,945 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 03:47:14,945 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 03:47:15,209 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 03:47:15,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 03:47:15,496 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 03:47:15,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 03:47:15,734 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 03:47:16,019 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-qg60.c.gcp-upstream.internal';"
2026-08-10 03:47:16,259 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 03:47:16,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 03:47:16,520 [I] DB_PATCHES have already been applied
I20260810 03:47:16.526780 23067 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWYy72V/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 03:47:16.526852 23067 mini_ranger.cc:193] Using host: 127.22.134.212
I20260810 03:47:16.531158 23067 mini_ranger.cc:227] Ranger admin URL: http://127.22.134.212:49603
Aug 10, 2026 3:47:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:47:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:47:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 3:47:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 3:47:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 3:47:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 3:47:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 03:47:17.722067 23067 mini_ranger.cc:160] Time spent starting Ranger: real 9.051s user 0.000s sys 0.012s
Aug 10, 2026 3:47:38 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 3:47:39 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 3:47:39 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 3:47:39 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 3:47:40 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 03:47:40.693976 23067 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.134.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.134.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/rangerkms_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.134.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/rangerkms_127.22.134.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.134.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.134.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.134.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/HTTP_127.22.134.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.134.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/HTTP_127.22.134.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 03:47:40 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333660, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 03:47:40.810150 23067 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 03:47:40.826084 23067 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 03:47:41.833097 23067 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 03:47:41.833200 23067 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms
I20260810 03:47:41.833220 23067 mini_ranger_kms.cc:227] Using postgres at 127.22.134.212:37667
2026-08-10 03:47:42,023 [I] DB FLAVOR :POSTGRES
2026-08-10 03:47:42,023 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 03:47:42,024 [I] Checking connection
2026-08-10 03:47:42,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 03:47:42,329 [I] connection success
2026-08-10 03:47:42,330 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 03:47:42,330 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 03:47:42,330 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 03:47:42,607 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 03:47:42,607 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 03:47:42,608 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 03:47:42,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.134.212:37667/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 03:47:42,896 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 03:47:43.450703 23067 mini_ranger_kms.cc:310] Created kms service
I20260810 03:47:43.664897 23067 mini_ranger_kms.cc:326] Created kudu user
I20260810 03:47:43.716135 23067 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 03:47:43 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333660, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:44.154898 23067 mini_ranger_kms.cc:384] Added ranger policy
I20260810 03:47:44.155073 23067 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWYy72V/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWYy72V/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 03:47:44.155102 23067 mini_ranger_kms.cc:240] Using host: 127.22.134.212
I20260810 03:47:44.160012 23067 mini_ranger_kms.cc:276] Ranger KMS PID: 4076
I20260810 03:47:44.160128 23067 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.134.212:35013
Aug 10, 2026 3:47:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:47:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:47:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 3:47:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 3:47:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 3:47:45 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 03:47:46 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786333666, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.134.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:46.612275 23067 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.802s user 0.018s sys 0.155s
I20260810 03:47:46.612412 23067 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 03:47:46.612479 23067 mini_ranger_kms.cc:401] 127.22.134.212:35013/kms/v1/keys
Aug 10 03:47:46 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333666, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.134.212@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
Aug 10 03:47:47 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333666, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.134.212@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
Aug 10 03:47:49 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:47:49.689277 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40523
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:40315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:40523
--ranger_config_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:35013/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:47:49.813818 4133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:49.814198 4133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:49.814293 4133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:49.818636 4133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:47:49.818737 4133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:49.818775 4133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:49.818836 4133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:47:49.818893 4133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:47:49.824930 4133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:40315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.134.212:35013/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:40523
--ranger_config_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:49.826225 4133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:49.827456 4133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:49.837507 4138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:49.837576 4139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:49.837729 4133 server_base.cc:1034] running on GCE node
W20260810 03:47:49.838006 4141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:49.838630 4133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:49.839964 4133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:49.841188 4133 hybrid_clock.cc:648] HybridClock initialized: now 1786333669841165 us; error 49 us; skew 500 ppm
Aug 10 03:47:49 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333669, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:49.849896 4133 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:47:49.851048 4133 webserver.cc:460] Webserver started at http://127.22.134.254:46609/ using document root <none> and password file <none>
I20260810 03:47:49.851649 4133 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:49.851737 4133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:49.851979 4133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:47:49 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333669, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:49.915501 4133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "a47aa83c94494dc887d2f88cffe180a1"
format_stamp: "Formatted at 2026-08-10 03:47:49 on dist-test-slave-qg60"
server_key: "38e2a944b2987ed377ccd2310ef5290f"
server_key_iv: "e638177518074a6b35ff031ec1922585"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:49.916241 4133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "a47aa83c94494dc887d2f88cffe180a1"
format_stamp: "Formatted at 2026-08-10 03:47:49 on dist-test-slave-qg60"
server_key: "38e2a944b2987ed377ccd2310ef5290f"
server_key_iv: "e638177518074a6b35ff031ec1922585"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:49.921078 4133 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260810 03:47:49.937916 4149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:49.939633 4133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:47:49.939823 4133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "a47aa83c94494dc887d2f88cffe180a1"
format_stamp: "Formatted at 2026-08-10 03:47:49 on dist-test-slave-qg60"
server_key: "38e2a944b2987ed377ccd2310ef5290f"
server_key_iv: "e638177518074a6b35ff031ec1922585"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:49.939986 4133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:49.966547 4133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:49.969913 4133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:49.970146 4133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:49.977999 4133 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:40523
I20260810 03:47:49.978048 4207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:40523 every 8 connection(s)
I20260810 03:47:49.979067 4133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:47:49.979599 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 4133
I20260810 03:47:49.979724 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:47:49.980038 23067 external_mini_cluster.cc:1428] Setting key 12c8836e98b254f95de6f81b24df0325
I20260810 03:47:49.982468 4208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:49.989460 4208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Bootstrap starting.
Aug 10 03:47:49 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:49.992128 4208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:49.993014 4208 log.cc:824] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:49.995188 4208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: No bootstrap required, opened a new log
I20260810 03:47:49.997984 4211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:49.981541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50346 (local address 127.22.134.254:40523)
0810 03:47:49.982048 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:49.982067 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:49.982286 (+ 219us) server_negotiation.cc:407] Connection header received
0810 03:47:49.983226 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:49.983249 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:49.983667 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:49.984046 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:49.984980 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:49.986477 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:49.987672 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:49.988407 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:49.988573 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:49.991827 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:49.991834 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:49.991853 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:49.991888 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:49.994693 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:49.995239 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:49.995245 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:49.995251 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:49.995381 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:49.995711 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:49.995714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:49.995715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:49.996224 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:49.996412 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:49.996724 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 03:47:49.997035 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":155,"threads_started":1}
I20260810 03:47:49.998754 4208 raft_consensus.cc:348] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } }
I20260810 03:47:49.998996 4208 raft_consensus.cc:374] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:49.999071 4208 raft_consensus.cc:729] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47aa83c94494dc887d2f88cffe180a1, State: Initialized, Role: FOLLOWER
I20260810 03:47:49.999562 4208 consensus_queue.cc:260] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } }
I20260810 03:47:49.999713 4208 raft_consensus.cc:388] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:47:49.999809 4208 raft_consensus.cc:482] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:47:49.999930 4208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:50.001155 4208 raft_consensus.cc:504] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } }
I20260810 03:47:50.001539 4208 leader_election.cc:302] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a47aa83c94494dc887d2f88cffe180a1; no voters:
I20260810 03:47:50.001893 4208 leader_election.cc:288] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:47:50.002034 4213 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:47:50.002257 4213 raft_consensus.cc:686] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 1 LEADER]: Becoming Leader. State: Replica: a47aa83c94494dc887d2f88cffe180a1, State: Running, Role: LEADER
I20260810 03:47:50.002666 4213 consensus_queue.cc:237] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } }
I20260810 03:47:50.003351 4208 sys_catalog.cc:564] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:47:50.003974 4213 sys_catalog.cc:455] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a47aa83c94494dc887d2f88cffe180a1. Latest consensus state: current_term: 1 leader_uuid: "a47aa83c94494dc887d2f88cffe180a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } } }
I20260810 03:47:50.004184 4213 sys_catalog.cc:458] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:47:50.004628 4214 sys_catalog.cc:455] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a47aa83c94494dc887d2f88cffe180a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } } }
I20260810 03:47:50.004787 4214 sys_catalog.cc:458] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:47:50.005936 4208 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 03:47:50.010217 4221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:47:50.014111 4221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:47:50.021559 4221 catalog_manager.cc:1347] Generated new cluster ID: d3fef341cce84ed48c5fb8269d5129db
I20260810 03:47:50.021634 4221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:47:50.050640 4221 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:47:50.052106 4221 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:47:50.064280 4221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Generated new TSK 0
I20260810 03:47:50.065512 4221 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:47:50.841892 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:35013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40523
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:40315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:47:50.970867 4260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:50.971156 4260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:50.971202 4260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:50.975641 4260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:50.975709 4260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:50.975778 4260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:47:50.982028 4260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:40315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.134.212:35013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:50.983240 4260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:50.984328 4260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:50.995755 4269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:50.996151 4267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:50.996234 4266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:50.997133 4260 server_base.cc:1034] running on GCE node
I20260810 03:47:50.997707 4260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:50.998471 4260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:51.001878 4260 hybrid_clock.cc:648] HybridClock initialized: now 1786333671001828 us; error 62 us; skew 500 ppm
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:51.006371 4260 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:47:51.007833 4260 webserver.cc:460] Webserver started at http://127.22.134.193:44583/ using document root <none> and password file <none>
I20260810 03:47:51.008594 4260 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:51.008767 4260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:51.009068 4260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:51.024794 4260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "5b834d1069964b84ace7aef17fc260ce"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "6e595bd463c062aeafec9c659c468b0e"
server_key_iv: "ab654adeeba7990c567fbc4c91e98732"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.025672 4260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "5b834d1069964b84ace7aef17fc260ce"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "6e595bd463c062aeafec9c659c468b0e"
server_key_iv: "ab654adeeba7990c567fbc4c91e98732"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.031631 4260 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 03:47:51.051985 4278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.053933 4260 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260810 03:47:51.054106 4260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "5b834d1069964b84ace7aef17fc260ce"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "6e595bd463c062aeafec9c659c468b0e"
server_key_iv: "ab654adeeba7990c567fbc4c91e98732"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.054297 4260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:51.103314 4260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:51.107174 4260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:51.107419 4260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:51.108156 4260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:51.109247 4260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:51.109328 4260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.109431 4260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:51.109493 4260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.121033 4260 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:38793
I20260810 03:47:51.121117 4410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:38793 every 8 connection(s)
I20260810 03:47:51.122063 4260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:47:51.123080 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 4260
I20260810 03:47:51.123248 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:47:51.123636 23067 external_mini_cluster.cc:1428] Setting key 447371fe49ea488485c6b64fb66ca124
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:51.152441 4413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:51.126205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40523 (local address 127.22.134.193:34719)
0810 03:47:51.126861 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:51.126921 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:51.133873 (+ 6952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:51.135041 (+ 1168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:51.135052 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:51.135486 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:51.136336 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:51.136358 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:51.137790 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:51.137794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:51.139505 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:51.139518 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:51.140836 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:51.140841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:51.141078 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:51.141857 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:51.141879 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:51.143944 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:51.146679 (+ 2735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:51.146686 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:51.146706 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:51.147145 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:51.149311 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:51.149315 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:51.149317 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:51.149576 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:51.150180 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:51.150188 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:51.150589 (+ 401us) client_negotiation.cc:769] Sending connection context
0810 03:47:51.150817 (+ 228us) client_negotiation.cc:240] Negotiation successful
0810 03:47:51.151230 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":160,"threads_started":1}
I20260810 03:47:51.153570 4414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:51.127371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:34719 (local address 127.22.134.254:40523)
0810 03:47:51.134456 (+ 7085us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:51.134462 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:51.134479 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:47:51.134526 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:51.134530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:51.134581 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:51.134679 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:51.136537 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:51.137619 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:51.139697 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:51.140407 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:51.140593 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:51.144264 (+ 3671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:51.144268 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:51.144271 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:51.144306 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:51.146526 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:51.149015 (+ 2489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:51.149019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:51.149021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:51.149152 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:51.149746 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:51.149750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:51.149751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:51.150022 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:51.150110 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:51.153185 (+ 3075us) server_negotiation.cc:299] Negotiation successful
0810 03:47:51.153369 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6978,"thread_start_us":69,"threads_started":1}
I20260810 03:47:51.155680 4411 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40523
I20260810 03:47:51.155968 4411 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:51.156646 4411 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:47:51.158806 4167 ts_manager.cc:194] Registered new tserver with Master: 5b834d1069964b84ace7aef17fc260ce (127.22.134.193:38793)
I20260810 03:47:51.160418 4167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:34719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:47:51.185465 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:35013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40523
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:40315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 03:47:51.354914 4418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:51.355372 4418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:51.355458 4418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:51.362592 4418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:51.362702 4418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:51.362803 4418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:47:51.372228 4418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:40315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.134.212:35013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:51.373813 4418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:51.375253 4418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:51.388993 4425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:51.389161 4418 server_base.cc:1034] running on GCE node
W20260810 03:47:51.389454 4424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:51.389634 4427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:51.390195 4418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:51.391099 4418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:51.392309 4418 hybrid_clock.cc:648] HybridClock initialized: now 1786333671392287 us; error 42 us; skew 500 ppm
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:51.396400 4418 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:47:51.397722 4418 webserver.cc:460] Webserver started at http://127.22.134.194:36389/ using document root <none> and password file <none>
I20260810 03:47:51.398594 4418 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:51.398696 4418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:51.398945 4418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:51.429471 4418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "da3528b7307e441696cad73158d42d94"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "a80c794effce755b4eaf5c42d6a7cb54"
server_key_iv: "d2439d6ac1e77a1e011904dfddc40420"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.435876 4418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "da3528b7307e441696cad73158d42d94"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "a80c794effce755b4eaf5c42d6a7cb54"
server_key_iv: "d2439d6ac1e77a1e011904dfddc40420"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.442443 4418 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260810 03:47:51.468609 4435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.470614 4418 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:47:51.470765 4418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "da3528b7307e441696cad73158d42d94"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "a80c794effce755b4eaf5c42d6a7cb54"
server_key_iv: "d2439d6ac1e77a1e011904dfddc40420"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.470921 4418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:51.509479 4418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:51.513955 4418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:51.514261 4418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:51.515069 4418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:51.516284 4418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:51.516409 4418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.516520 4418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:51.516590 4418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.527715 4418 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:37595
I20260810 03:47:51.529101 4418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:47:51.537510 4567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:37595 every 8 connection(s)
I20260810 03:47:51.540261 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 4418
I20260810 03:47:51.540422 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:47:51.540827 23067 external_mini_cluster.cc:1428] Setting key 82265364d5e45f7164857668fc8de17e
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:51.578500 4414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:51.541077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:42483 (local address 127.22.134.254:40523)
0810 03:47:51.541224 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:51.541228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:51.556585 (+ 15357us) server_negotiation.cc:407] Connection header received
0810 03:47:51.558576 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:51.558582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:51.558651 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:51.558713 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:51.561217 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:51.562127 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:51.565012 (+ 2885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:51.565442 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:51.565536 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:51.572971 (+ 7435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:51.572977 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:51.572980 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:51.573017 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:51.575018 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:51.576027 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:51.576031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:51.576033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:51.576172 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:51.576800 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:51.576804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:51.576806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:51.577132 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:51.577236 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:51.578137 (+ 901us) server_negotiation.cc:299] Negotiation successful
0810 03:47:51.578302 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:47:51.580674 4571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:51.541647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40523 (local address 127.22.134.194:42483)
0810 03:47:51.555806 (+ 14159us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:51.555906 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:51.558230 (+ 2324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:51.559228 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:51.559609 (+ 381us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:51.560043 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:51.560973 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:51.560998 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:51.562614 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:51.562618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:51.564818 (+ 2200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:51.564848 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:51.565790 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:51.565794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:51.566036 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:51.570401 (+ 4365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:51.570428 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:51.572636 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:51.575226 (+ 2590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:51.575234 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:51.575257 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:51.575860 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:51.576320 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:51.576323 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:51.576326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:51.576608 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:51.577375 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:51.577383 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:51.577784 (+ 401us) client_negotiation.cc:769] Sending connection context
0810 03:47:51.579023 (+ 1239us) client_negotiation.cc:240] Negotiation successful
0810 03:47:51.579455 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13762,"thread_start_us":191,"threads_started":1}
I20260810 03:47:51.582651 4568 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40523
I20260810 03:47:51.582929 4568 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:51.583639 4568 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
I20260810 03:47:51.585608 4167 ts_manager.cc:194] Registered new tserver with Master: da3528b7307e441696cad73158d42d94 (127.22.134.194:37595)
I20260810 03:47:51.586457 4167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:42483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:47:51.608577 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:35013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40523
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:40315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
W20260810 03:47:51.802989 4575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:51.804226 4575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:51.804368 4575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:51.811172 4575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:51.811358 4575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:51.811529 4575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:47:51.819717 4575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:40315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.134.212:35013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:51.821502 4575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:51.822996 4575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:51.839466 4580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:51.839358 4581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:51.840122 4585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:51.840975 4575 server_base.cc:1034] running on GCE node
I20260810 03:47:51.841584 4575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:51.842589 4575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:51.843993 4575 hybrid_clock.cc:648] HybridClock initialized: now 1786333671843925 us; error 105 us; skew 500 ppm
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:51.848780 4575 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:47:51.850361 4575 webserver.cc:460] Webserver started at http://127.22.134.195:45633/ using document root <none> and password file <none>
I20260810 03:47:51.851343 4575 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:51.851500 4575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:51.851832 4575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 03:47:51 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:51.876112 4575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "609ca40ab6fc4f04a9979143337d8371"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "17b30b2b025984eb4235d1ddf66d8710"
server_key_iv: "a473176cafc95ee8310586afa67ad81c"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.877327 4575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "609ca40ab6fc4f04a9979143337d8371"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "17b30b2b025984eb4235d1ddf66d8710"
server_key_iv: "a473176cafc95ee8310586afa67ad81c"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.886715 4575 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.001s
I20260810 03:47:51.919485 4593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.921439 4575 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260810 03:47:51.921698 4575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "609ca40ab6fc4f04a9979143337d8371"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "17b30b2b025984eb4235d1ddf66d8710"
server_key_iv: "a473176cafc95ee8310586afa67ad81c"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:51.921947 4575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:51.951519 4575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:51.955083 4575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:51.955345 4575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:51.956097 4575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:51.957108 4575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:51.957182 4575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.957289 4575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:51.957335 4575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:51.976387 4575 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:33821
I20260810 03:47:51.977943 4575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:47:51.979314 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 4575
I20260810 03:47:51.979466 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:47:51.979821 23067 external_mini_cluster.cc:1428] Setting key 3d9921012873aec1681ffbf7dc47ad3a
I20260810 03:47:51.993796 4722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:33821 every 8 connection(s)
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:52.013808 4414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:51.993016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35205 (local address 127.22.134.254:40523)
0810 03:47:51.993163 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:51.993168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:51.995523 (+ 2355us) server_negotiation.cc:407] Connection header received
0810 03:47:51.997030 (+ 1507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:51.997035 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:51.997111 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:51.997170 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:51.999307 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.000303 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.002799 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.003467 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.003573 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:52.007842 (+ 4269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:52.007848 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:52.007851 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:52.007889 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:52.010323 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:52.011310 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:52.011326 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:52.011328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:52.011440 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:52.011983 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:52.011988 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:52.011990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:52.012329 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:52.012460 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:52.013407 (+ 947us) server_negotiation.cc:299] Negotiation successful
0810 03:47:52.013586 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:47:52.016130 4726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:51.991907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40523 (local address 127.22.134.195:35205)
0810 03:47:51.995331 (+ 3424us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:51.995404 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:51.996688 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:51.997717 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:51.997729 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:51.998204 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:51.999069 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:51.999107 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.000499 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.000503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:52.002534 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:52.002550 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.003873 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.003879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:52.004212 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:52.005199 (+ 987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:52.005231 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:52.007550 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:52.010564 (+ 3014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:52.010573 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:52.010598 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:52.011144 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:52.011588 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:52.011591 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:52.011593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:52.011844 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:52.012544 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:52.012551 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:52.013043 (+ 492us) client_negotiation.cc:769] Sending connection context
0810 03:47:52.014405 (+ 1362us) client_negotiation.cc:240] Negotiation successful
0810 03:47:52.014855 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3140,"thread_start_us":218,"threads_started":1}
I20260810 03:47:52.018119 4724 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40523
I20260810 03:47:52.018442 4724 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:52.019410 4724 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
I20260810 03:47:52.021070 4164 ts_manager.cc:194] Registered new tserver with Master: 609ca40ab6fc4f04a9979143337d8371 (127.22.134.195:33821)
I20260810 03:47:52.022276 4164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:35205
I20260810 03:47:52.031018 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:47:52.031987 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 4260
I20260810 03:47:52.054078 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 4418
I20260810 03:47:52.064436 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 4575
I20260810 03:47:52.082996 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 4133
I20260810 03:47:52.094908 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40523
--webserver_interface=127.22.134.254
--webserver_port=46609
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:40315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:40523
--ranger_config_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:35013/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.134.212:35013/kms with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:47:52.215196 4727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:52.215485 4727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:52.215526 4727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:52.219784 4727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:47:52.219863 4727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:52.219882 4727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:52.219899 4727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:47:52.219914 4727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:47:52.226202 4727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:40315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.134.212:35013/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:40523
--ranger_config_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=46609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:52.227399 4727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:52.228513 4727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:52.237890 4733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:52.237908 4734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:52.237908 4738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:52.237959 4727 server_base.cc:1034] running on GCE node
I20260810 03:47:52.238834 4727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:52.239984 4727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:52.241189 4727 hybrid_clock.cc:648] HybridClock initialized: now 1786333672241167 us; error 37 us; skew 500 ppm
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333672, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:52.244668 4727 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:47:52.245669 4727 webserver.cc:460] Webserver started at http://127.22.134.254:46609/ using document root <none> and password file <none>
I20260810 03:47:52.246318 4727 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:52.246436 4727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333672, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:52.336894 4727 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:47:52.339783 4748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:52.341522 4727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:47:52.341704 4727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "a47aa83c94494dc887d2f88cffe180a1"
format_stamp: "Formatted at 2026-08-10 03:47:49 on dist-test-slave-qg60"
server_key: "38e2a944b2987ed377ccd2310ef5290f"
server_key_iv: "e638177518074a6b35ff031ec1922585"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:52.342365 4727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:52.361986 4727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:52.365409 4727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:52.365643 4727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:52.373288 4727 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:40523
I20260810 03:47:52.373315 4804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:40523 every 8 connection(s)
I20260810 03:47:52.374468 4727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:47:52.375092 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 4727
I20260810 03:47:52.375573 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:35013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:38793
--local_ip_for_outbound_sockets=127.22.134.193
--tserver_master_addrs=127.22.134.254:40523
--webserver_port=44583
--webserver_interface=127.22.134.193
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:40315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.134.212:35013/kms with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:47:52.379261 4805 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:47:52.381126 4805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Bootstrap starting.
I20260810 03:47:52.398614 4805 log.cc:824] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:52.405892 4805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:47:52.406353 4805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Bootstrap complete.
I20260810 03:47:52.410807 4805 raft_consensus.cc:348] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } }
I20260810 03:47:52.411319 4805 raft_consensus.cc:729] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47aa83c94494dc887d2f88cffe180a1, State: Initialized, Role: FOLLOWER
I20260810 03:47:52.411881 4805 consensus_queue.cc:260] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } }
I20260810 03:47:52.412045 4805 raft_consensus.cc:388] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:47:52.412158 4805 raft_consensus.cc:482] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:47:52.412286 4805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:47:52.414546 4805 raft_consensus.cc:504] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } }
I20260810 03:47:52.414934 4805 leader_election.cc:302] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a47aa83c94494dc887d2f88cffe180a1; no voters:
I20260810 03:47:52.415338 4805 leader_election.cc:288] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 03:47:52.415421 4811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:47:52.415699 4811 raft_consensus.cc:686] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [term 2 LEADER]: Becoming Leader. State: Replica: a47aa83c94494dc887d2f88cffe180a1, State: Running, Role: LEADER
I20260810 03:47:52.416103 4811 consensus_queue.cc:237] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } }
I20260810 03:47:52.416754 4805 sys_catalog.cc:564] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:47:52.417627 4813 sys_catalog.cc:455] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a47aa83c94494dc887d2f88cffe180a1. Latest consensus state: current_term: 2 leader_uuid: "a47aa83c94494dc887d2f88cffe180a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } } }
I20260810 03:47:52.417768 4813 sys_catalog.cc:458] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:47:52.418466 4812 sys_catalog.cc:455] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a47aa83c94494dc887d2f88cffe180a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a47aa83c94494dc887d2f88cffe180a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40523 } } }
I20260810 03:47:52.418576 4812 sys_catalog.cc:458] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:47:52.419075 4818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:47:52.419447 4805 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 03:47:52.426052 4818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:47:52.427043 4818 catalog_manager.cc:1259] Loaded cluster ID: d3fef341cce84ed48c5fb8269d5129db
I20260810 03:47:52.427160 4818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:47:52.429957 4818 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:47:52.430792 4818 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Loaded TSK: 0
I20260810 03:47:52.432253 4818 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:47:52.508945 4808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:52.509348 4808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:52.509462 4808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:52.514688 4808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:52.514789 4808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:52.514901 4808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:47:52.521824 4808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:40315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.134.212:35013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:38793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=44583
--tserver_master_addrs=127.22.134.254:40523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:52.523363 4808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:52.524524 4808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:52.538213 4850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:52.538506 4849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:52.540681 4852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:52.541896 4808 server_base.cc:1034] running on GCE node
I20260810 03:47:52.542659 4808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:52.543533 4808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:52.546844 4808 hybrid_clock.cc:648] HybridClock initialized: now 1786333672546790 us; error 63 us; skew 500 ppm
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333672, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:52.551123 4808 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:47:52.552335 4808 webserver.cc:460] Webserver started at http://127.22.134.193:44583/ using document root <none> and password file <none>
I20260810 03:47:52.553097 4808 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:52.553202 4808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333672, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:52.576283 4808 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260810 03:47:52.580888 4861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:52.582881 4808 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260810 03:47:52.583096 4808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "5b834d1069964b84ace7aef17fc260ce"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "6e595bd463c062aeafec9c659c468b0e"
server_key_iv: "ab654adeeba7990c567fbc4c91e98732"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:52.583992 4808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:52.608320 4808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:52.612980 4808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:52.613291 4808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:52.614225 4808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:52.615571 4808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:52.615707 4808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 03:47:52.615876 4808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:52.615984 4808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:52.628057 4808 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:38793
I20260810 03:47:52.629858 4808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:47:52.629905 4987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:38793 every 8 connection(s)
I20260810 03:47:52.635385 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 4808
I20260810 03:47:52.635965 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:35013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:37595
--local_ip_for_outbound_sockets=127.22.134.194
--tserver_master_addrs=127.22.134.254:40523
--webserver_port=36389
--webserver_interface=127.22.134.194
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:40315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.134.212:35013/kms with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333672, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:52.666414 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:52.636439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40523 (local address 127.22.134.193:38721)
0810 03:47:52.644158 (+ 7719us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:52.644238 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:52.646219 (+ 1981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:52.648569 (+ 2350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:52.648581 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:52.649076 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:52.649968 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:52.649996 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.652701 (+ 2705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.652705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:52.654401 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:52.654418 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.655737 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.655742 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:52.655976 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:52.656852 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:52.656880 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:52.658862 (+ 1982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:52.661977 (+ 3115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:52.661985 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:52.662004 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:52.662440 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:52.663022 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:52.663026 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:52.663028 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:52.663234 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:52.664164 (+ 930us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:52.664173 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:52.664529 (+ 356us) client_negotiation.cc:769] Sending connection context
0810 03:47:52.664814 (+ 285us) client_negotiation.cc:240] Negotiation successful
0810 03:47:52.665221 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7420,"thread_start_us":194,"threads_started":1}
I20260810 03:47:52.668509 4995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:52.638226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:38721 (local address 127.22.134.254:40523)
0810 03:47:52.646911 (+ 8685us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:52.646940 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:52.646996 (+ 56us) server_negotiation.cc:407] Connection header received
0810 03:47:52.647370 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:52.647389 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:52.647933 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:52.650301 (+ 2368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:52.650686 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.652467 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.654634 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.655485 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.656476 (+ 991us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:52.659158 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:52.659166 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:52.659187 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:52.659228 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:52.661798 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:52.662680 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:52.662687 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:52.662694 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:52.662876 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:52.663381 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:52.663385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:52.663388 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:52.664005 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:52.666940 (+ 2935us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:52.667128 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 03:47:52.667479 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8474,"thread_start_us":133,"threads_started":1}
I20260810 03:47:52.671927 4988 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40523
I20260810 03:47:52.672230 4988 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:52.672979 4988 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
W20260810 03:47:52.675799 4988 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:40523 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 03:47:52.675951 4988 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:52.676177 4988 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
I20260810 03:47:52.677302 4988 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:52.677502 4988 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
W20260810 03:47:52.678416 4988 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:47:52.830767 4994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:52.831101 4994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:52.831151 4994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:52.837193 4994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:52.837302 4994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:52.837433 4994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:47:52.844341 4994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:40315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.134.212:35013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:37595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=36389
--tserver_master_addrs=127.22.134.254:40523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:52.846024 4994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:52.847500 4994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:52.860905 5003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:52.860924 5000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:52.860921 5001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:52.861479 4994 server_base.cc:1034] running on GCE node
I20260810 03:47:52.862046 4994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:52.862982 4994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:52.864207 4994 hybrid_clock.cc:648] HybridClock initialized: now 1786333672864163 us; error 59 us; skew 500 ppm
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333672, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:52.869324 4994 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:47:52.870623 4994 webserver.cc:460] Webserver started at http://127.22.134.194:36389/ using document root <none> and password file <none>
I20260810 03:47:52.871390 4994 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:52.871528 4994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333672, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:52.894613 4994 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.000s sys 0.003s
I20260810 03:47:52.898393 5011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:52.900161 4994 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260810 03:47:52.900470 4994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "da3528b7307e441696cad73158d42d94"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "a80c794effce755b4eaf5c42d6a7cb54"
server_key_iv: "d2439d6ac1e77a1e011904dfddc40420"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:52.901551 4994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:52.937804 4994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:52.942591 4994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:52.942935 4994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:52.943899 4994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:52.945286 4994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:52.945432 4994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260810 03:47:52.945581 4994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:52.945663 4994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:52.959467 4994 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:37595
I20260810 03:47:52.959549 5138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:37595 every 8 connection(s)
I20260810 03:47:52.961143 4994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:47:52.969121 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 4994
I20260810 03:47:52.969712 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.134.212:35013/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:33821
--local_ip_for_outbound_sockets=127.22.134.195
--tserver_master_addrs=127.22.134.254:40523
--webserver_port=45633
--webserver_interface=127.22.134.195
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:40315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.134.212:35013/kms with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:47:52 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333672, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:52.983045 4995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:52.966989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:60945 (local address 127.22.134.254:40523)
0810 03:47:52.967148 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:52.967153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:52.967175 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:47:52.968097 (+ 922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:52.968102 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:52.968166 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:52.968293 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:52.970112 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.971050 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.973140 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.973568 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.973672 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:52.977603 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:52.977608 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:52.977611 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:52.977650 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:52.979706 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:52.980568 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:52.980573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:52.980575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:52.980682 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:52.981250 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:52.981255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:52.981256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:52.981534 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:52.981638 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:52.982552 (+ 914us) server_negotiation.cc:299] Negotiation successful
0810 03:47:52.982761 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:47:52.984035 5141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:52.965743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40523 (local address 127.22.134.194:60945)
0810 03:47:52.966449 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:52.966522 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:52.967800 (+ 1278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:52.968557 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:52.968570 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:52.969060 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:52.969874 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:52.969903 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.971255 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.971258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:52.972953 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:52.972970 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:52.973944 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:52.973950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:52.974193 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:52.975078 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:52.975105 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:52.977299 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:52.979916 (+ 2617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:52.979924 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:52.979947 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:52.980422 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:52.980845 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:52.980849 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:52.980851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:52.981117 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:52.981717 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:52.981725 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:52.982149 (+ 424us) client_negotiation.cc:769] Sending connection context
0810 03:47:52.982405 (+ 256us) client_negotiation.cc:240] Negotiation successful
0810 03:47:52.982810 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":195,"threads_started":1}
I20260810 03:47:52.986542 5139 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40523
I20260810 03:47:52.987305 5139 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:52.988045 5139 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
W20260810 03:47:52.990337 5139 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:40523 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 03:47:52.990487 5139 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:52.990726 5139 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
I20260810 03:47:52.991858 5139 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:52.992061 5139 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
W20260810 03:47:52.993000 5139 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:47:53.134624 5142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:53.135070 5142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:53.135150 5142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:53.142319 5142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:53.142503 5142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:53.142692 5142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:47:53.151058 5142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:40315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.134.212:35013/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:33821
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=45633
--tserver_master_addrs=127.22.134.254:40523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:53.152455 5142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:53.153817 5142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:53.167093 5151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:53.167444 5142 server_base.cc:1034] running on GCE node
W20260810 03:47:53.167456 5148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:53.167714 5149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:53.168195 5142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:53.169028 5142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:53.170257 5142 hybrid_clock.cc:648] HybridClock initialized: now 1786333673170222 us; error 48 us; skew 500 ppm
Aug 10 03:47:53 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333673, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:53.173699 5142 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:47:53.174695 5142 webserver.cc:460] Webserver started at http://127.22.134.195:45633/ using document root <none> and password file <none>
I20260810 03:47:53.175347 5142 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:53.175462 5142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 03:47:53 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333673, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:53.195850 5142 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:47:53.199040 5159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:53.200649 5142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:47:53.200865 5142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "609ca40ab6fc4f04a9979143337d8371"
format_stamp: "Formatted at 2026-08-10 03:47:51 on dist-test-slave-qg60"
server_key: "17b30b2b025984eb4235d1ddf66d8710"
server_key_iv: "a473176cafc95ee8310586afa67ad81c"
server_key_version: "kuduclusterkey@0"
I20260810 03:47:53.201644 5142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:53.225729 5142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:53.230031 5142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:53.230347 5142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:53.231225 5142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:47:53.232465 5142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:47:53.232597 5142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:53.232717 5142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:47:53.232831 5142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:53.247671 5142 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:33821
I20260810 03:47:53.247689 5285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:33821 every 8 connection(s)
I20260810 03:47:53.249003 5142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:47:53.253482 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 5142
Aug 10 03:47:53 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333673, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:53.265189 5291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:53.254660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50352 (local address 127.22.134.254:40523)
0810 03:47:53.254910 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:53.254915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:53.254927 (+ 12us) server_negotiation.cc:407] Connection header received
0810 03:47:53.254964 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:53.254967 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:53.255010 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:53.256207 (+ 1197us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:53.256298 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:53.257065 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:53.258293 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:53.258620 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:53.258717 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:53.260795 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:53.260799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:53.260802 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:53.260827 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:53.263122 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:53.263641 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:53.263645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:53.263656 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:53.263756 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:53.264094 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:53.264098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:53.264099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:53.264345 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:53.264564 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:53.264815 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 03:47:53.264958 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":87,"threads_started":1}
I20260810 03:47:53.266287 4995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:53.251348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:51891 (local address 127.22.134.254:40523)
0810 03:47:53.251529 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:53.251534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:53.252505 (+ 971us) server_negotiation.cc:407] Connection header received
0810 03:47:53.253622 (+ 1117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:53.253626 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:53.253690 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:53.253774 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:53.255233 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:53.256091 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:53.257645 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:53.257959 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:53.258084 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:53.260973 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:53.260977 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:53.260982 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:53.261033 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:53.263130 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:53.264469 (+ 1339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:53.264472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:53.264473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:53.264564 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:53.265042 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:53.265045 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:53.265047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:53.265234 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:53.265320 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:53.266034 (+ 714us) server_negotiation.cc:299] Negotiation successful
0810 03:47:53.266145 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 03:47:53.268132 5288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:53.251775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40523 (local address 127.22.134.195:51891)
0810 03:47:53.252309 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:53.252366 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:53.253379 (+ 1013us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:53.253961 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:53.253968 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:53.254250 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:53.254993 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:53.255014 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:53.256257 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:53.256260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:53.257505 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:53.257521 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:53.258130 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:53.258134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:53.258358 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:53.259091 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:53.259113 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:53.260778 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:53.263259 (+ 2481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:53.263265 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:53.263290 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:53.264353 (+ 1063us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:53.264682 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:53.264684 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:53.264706 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:53.264926 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:53.265393 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:53.265399 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:53.265763 (+ 364us) client_negotiation.cc:769] Sending connection context
0810 03:47:53.265968 (+ 205us) client_negotiation.cc:240] Negotiation successful
0810 03:47:53.266310 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":160,"threads_started":1}
I20260810 03:47:53.269822 5286 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40523
I20260810 03:47:53.270174 5286 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:53.270901 5286 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
W20260810 03:47:53.272724 5286 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:40523 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 03:47:53.272946 5286 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:53.273193 5286 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
I20260810 03:47:53.275058 5286 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:53.275328 5286 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
W20260810 03:47:53.276278 5286 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 03:47:53 dist-test-slave-qg60 krb5kdc[3632](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786333673, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:53.678675 4988 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:53.679020 4988 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
I20260810 03:47:53.680346 4766 ts_manager.cc:194] Registered new tserver with Master: 5b834d1069964b84ace7aef17fc260ce (127.22.134.193:38793)
I20260810 03:47:53.682430 4766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:38721
I20260810 03:47:53.993295 5139 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:53.993670 5139 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
I20260810 03:47:53.994630 4766 ts_manager.cc:194] Registered new tserver with Master: da3528b7307e441696cad73158d42d94 (127.22.134.194:37595)
I20260810 03:47:53.995528 4766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:60945
Aug 10 03:47:54 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333673, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:54.276533 5286 heartbeater.cc:464] Registering TS with master...
I20260810 03:47:54.276926 5286 heartbeater.cc:511] Master 127.22.134.254:40523 requested a full tablet report, sending...
I20260810 03:47:54.277899 4766 ts_manager.cc:194] Registered new tserver with Master: 609ca40ab6fc4f04a9979143337d8371 (127.22.134.195:33821)
I20260810 03:47:54.278811 4766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:51891
I20260810 03:47:54.285059 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:47:54.301885 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.290345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.22.134.254:40523)
0810 03:47:54.290805 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:54.290810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:54.291143 (+ 333us) server_negotiation.cc:407] Connection header received
0810 03:47:54.291442 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:54.291446 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:54.291505 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:54.291576 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:54.292699 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.293562 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.294811 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.295194 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.295329 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.297450 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:54.297455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:54.297458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:54.297509 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:54.299549 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:54.300106 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:54.300110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:54.300112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:54.300235 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:54.300580 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:54.300584 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:54.300586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:54.301023 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:54.301177 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:54.301524 (+ 347us) server_negotiation.cc:299] Negotiation successful
0810 03:47:54.301683 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":127,"threads_started":1}
I20260810 03:47:54.306975 4766 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:47:54.312250 4766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 10 03:47:54 dist-test-slave-qg60 krb5kdc[3632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333673, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for HTTP/127.22.134.212@KRBTEST.COM
I20260810 03:47:54.348647 5323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.336021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:38793 (local address 127.0.0.1:45858)
0810 03:47:54.338863 (+ 2842us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:54.338939 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:54.339252 (+ 313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:54.340487 (+ 1235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:54.340494 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:54.340522 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:54.340675 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.340682 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.342782 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.342785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.344358 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.344371 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.346201 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.346205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.348130 (+ 1925us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.348196 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 03:47:54.348319 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 03:47:54.348454 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2636,"thread_start_us":134,"threads_started":1}
I20260810 03:47:54.349452 5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.337482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45858 (local address 127.22.134.193:38793)
0810 03:47:54.339591 (+ 2109us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:54.339599 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:54.339627 (+ 28us) server_negotiation.cc:407] Connection header received
0810 03:47:54.339718 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:54.339724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:54.339976 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:54.340278 (+ 302us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:54.340867 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.342130 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.344534 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.345763 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.345897 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.346107 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:54.349156 (+ 3049us) server_negotiation.cc:299] Negotiation successful
0810 03:47:54.349290 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1973,"thread_start_us":120,"threads_started":1}
I20260810 03:47:54.354226 5319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.337004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:33821 (local address 127.0.0.1:50248)
0810 03:47:54.344922 (+ 7918us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:54.344939 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:54.345206 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:54.347062 (+ 1856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:54.347068 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:54.347095 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:54.347234 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.347244 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.350867 (+ 3623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.350871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.352164 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.352178 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.353728 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.353732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.353839 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.353866 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 03:47:54.353955 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 03:47:54.354069 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7835,"thread_start_us":112,"threads_started":1}
I20260810 03:47:54.353965 4915 tablet_service.cc:1467] Processing CreateTablet for tablet a7be1863b19846999270855a45d5a29f (DEFAULT_TABLE table=test-table [id=7d9946e20ea34ff0a1f69949c1d3cb97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:47:54.355408 4915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7be1863b19846999270855a45d5a29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:54.356674 5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.337861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50248 (local address 127.22.134.195:33821)
0810 03:47:54.338386 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:54.338395 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:54.346228 (+ 7833us) server_negotiation.cc:407] Connection header received
0810 03:47:54.346327 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:54.346333 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:54.346534 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:54.346852 (+ 318us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:54.347382 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.348678 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.352344 (+ 3666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.353329 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.353470 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.353650 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:54.356366 (+ 2716us) server_negotiation.cc:299] Negotiation successful
0810 03:47:54.356504 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":271,"threads_started":1}
I20260810 03:47:54.357612 5320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.336118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:37595 (local address 127.0.0.1:39530)
0810 03:47:54.342416 (+ 6298us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:54.342434 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:54.342677 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:54.348880 (+ 6203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:54.348883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:54.348904 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:54.349064 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.349074 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.354513 (+ 5439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.354517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.355793 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.355807 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.357167 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.357171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.357287 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.357318 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 03:47:54.357373 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 03:47:54.357455 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6215,"thread_start_us":145,"threads_started":1}
I20260810 03:47:54.358639 5321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.336300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39530 (local address 127.22.134.194:37595)
0810 03:47:54.345504 (+ 9204us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:54.345513 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:54.345545 (+ 32us) server_negotiation.cc:407] Connection header received
0810 03:47:54.345636 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:54.345642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:54.345924 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:54.349262 (+ 3338us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:54.349428 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.350650 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.356013 (+ 5363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.356990 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.358166 (+ 1176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.358325 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:54.358386 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 03:47:54.358492 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9066,"thread_start_us":64,"threads_started":1}
I20260810 03:47:54.360381 5214 tablet_service.cc:1467] Processing CreateTablet for tablet a7be1863b19846999270855a45d5a29f (DEFAULT_TABLE table=test-table [id=7d9946e20ea34ff0a1f69949c1d3cb97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:47:54.361728 5065 tablet_service.cc:1467] Processing CreateTablet for tablet a7be1863b19846999270855a45d5a29f (DEFAULT_TABLE table=test-table [id=7d9946e20ea34ff0a1f69949c1d3cb97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:47:54.362901 5214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7be1863b19846999270855a45d5a29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:54.362905 5065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7be1863b19846999270855a45d5a29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:54.375288 5328 tablet_bootstrap.cc:492] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Bootstrap starting.
I20260810 03:47:54.378165 5328 tablet_bootstrap.cc:654] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:54.379120 5328 log.cc:824] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:54.382356 5328 tablet_bootstrap.cc:492] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: No bootstrap required, opened a new log
I20260810 03:47:54.382618 5328 ts_tablet_manager.cc:1397] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 03:47:54.386920 5328 raft_consensus.cc:348] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.387253 5328 raft_consensus.cc:374] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:54.387306 5328 raft_consensus.cc:729] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3528b7307e441696cad73158d42d94, State: Initialized, Role: FOLLOWER
I20260810 03:47:54.387902 5328 consensus_queue.cc:260] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.389168 5328 ts_tablet_manager.cc:1428] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260810 03:47:54.389631 5139 heartbeater.cc:503] Master 127.22.134.254:40523 was elected leader, sending a full tablet report...
I20260810 03:47:54.399149 5331 tablet_bootstrap.cc:492] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce: Bootstrap starting.
I20260810 03:47:54.401264 5332 tablet_bootstrap.cc:492] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Bootstrap starting.
I20260810 03:47:54.402683 5331 tablet_bootstrap.cc:654] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:54.403599 5332 tablet_bootstrap.cc:654] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:54.403713 5331 log.cc:824] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:54.404450 5332 log.cc:824] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:54.407927 5331 tablet_bootstrap.cc:492] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce: No bootstrap required, opened a new log
I20260810 03:47:54.407912 5332 tablet_bootstrap.cc:492] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: No bootstrap required, opened a new log
I20260810 03:47:54.408164 5332 ts_tablet_manager.cc:1397] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 03:47:54.408164 5331 ts_tablet_manager.cc:1397] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260810 03:47:54.412600 5332 raft_consensus.cc:348] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.412600 5331 raft_consensus.cc:348] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.413008 5331 raft_consensus.cc:374] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:54.413002 5332 raft_consensus.cc:374] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:54.413086 5331 raft_consensus.cc:729] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b834d1069964b84ace7aef17fc260ce, State: Initialized, Role: FOLLOWER
I20260810 03:47:54.413074 5332 raft_consensus.cc:729] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 609ca40ab6fc4f04a9979143337d8371, State: Initialized, Role: FOLLOWER
I20260810 03:47:54.413686 5332 consensus_queue.cc:260] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.413671 5331 consensus_queue.cc:260] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.414915 5332 ts_tablet_manager.cc:1428] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 03:47:54.414915 5331 ts_tablet_manager.cc:1428] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:47:54.415331 4988 heartbeater.cc:503] Master 127.22.134.254:40523 was elected leader, sending a full tablet report...
I20260810 03:47:54.419940 5286 heartbeater.cc:503] Master 127.22.134.254:40523 was elected leader, sending a full tablet report...
W20260810 03:47:54.464365 5140 tablet.cc:2369] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:47:54.471351 5330 raft_consensus.cc:482] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:47:54.471621 5330 raft_consensus.cc:504] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.473165 5330 leader_election.cc:288] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b834d1069964b84ace7aef17fc260ce (127.22.134.193:38793), 609ca40ab6fc4f04a9979143337d8371 (127.22.134.195:33821)
I20260810 03:47:54.480410 5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.474066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:57489 (local address 127.22.134.195:33821)
0810 03:47:54.474231 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:54.474237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:54.475550 (+ 1313us) server_negotiation.cc:407] Connection header received
0810 03:47:54.475709 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:54.475713 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:54.475765 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:54.475865 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:54.476257 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.477122 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.478932 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.479545 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.479651 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.479709 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:54.480167 (+ 458us) server_negotiation.cc:299] Negotiation successful
0810 03:47:54.480264 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:47:54.481024 5340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.473613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:33821 (local address 127.22.134.194:57489)
0810 03:47:54.475436 (+ 1823us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:54.475453 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:54.475598 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:54.475910 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:54.475914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:54.475938 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:54.476114 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.476121 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.477299 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.477302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.478773 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.478784 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.479822 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.479826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.480006 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.480032 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:47:54.480747 (+ 715us) client_negotiation.cc:240] Negotiation successful
0810 03:47:54.480847 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1747,"mutex_wait_us":94,"thread_start_us":127,"threads_started":1}
I20260810 03:47:54.481797 5222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7be1863b19846999270855a45d5a29f" candidate_uuid: "da3528b7307e441696cad73158d42d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "609ca40ab6fc4f04a9979143337d8371" is_pre_election: true
I20260810 03:47:54.482223 5222 raft_consensus.cc:2454] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3528b7307e441696cad73158d42d94 in term 0.
I20260810 03:47:54.482546 5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.474779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:49405 (local address 127.22.134.193:38793)
0810 03:47:54.474920 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:54.474925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:54.475897 (+ 972us) server_negotiation.cc:407] Connection header received
0810 03:47:54.476097 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:54.476100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:54.476156 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:54.476215 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:47:54.476616 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.477378 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.478931 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.479545 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.479651 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.479708 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:54.482293 (+ 2585us) server_negotiation.cc:299] Negotiation successful
0810 03:47:54.482401 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:47:54.482841 5013 leader_election.cc:302] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 609ca40ab6fc4f04a9979143337d8371, da3528b7307e441696cad73158d42d94; no voters:
I20260810 03:47:54.483002 5342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.474329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:38793 (local address 127.22.134.194:49405)
0810 03:47:54.475797 (+ 1468us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:54.475807 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:54.475955 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:54.476353 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:54.476355 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:54.476371 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:47:54.476486 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.476492 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.477516 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.477519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.478773 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:54.478784 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.479822 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.479826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:54.482101 (+ 2275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.482129 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 03:47:54.482765 (+ 636us) client_negotiation.cc:240] Negotiation successful
0810 03:47:54.482851 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1420,"mutex_wait_us":2096,"thread_start_us":143,"threads_started":1}
I20260810 03:47:54.483218 5330 raft_consensus.cc:2781] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:47:54.483319 5330 raft_consensus.cc:482] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:47:54.483379 5330 raft_consensus.cc:3037] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:54.483681 4935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7be1863b19846999270855a45d5a29f" candidate_uuid: "da3528b7307e441696cad73158d42d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b834d1069964b84ace7aef17fc260ce" is_pre_election: true
I20260810 03:47:54.484019 4935 raft_consensus.cc:2454] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da3528b7307e441696cad73158d42d94 in term 0.
I20260810 03:47:54.484899 5330 raft_consensus.cc:504] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.485324 5330 leader_election.cc:288] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [CANDIDATE]: Term 1 election: Requested vote from peers 5b834d1069964b84ace7aef17fc260ce (127.22.134.193:38793), 609ca40ab6fc4f04a9979143337d8371 (127.22.134.195:33821)
I20260810 03:47:54.485836 4935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7be1863b19846999270855a45d5a29f" candidate_uuid: "da3528b7307e441696cad73158d42d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b834d1069964b84ace7aef17fc260ce"
I20260810 03:47:54.485980 4935 raft_consensus.cc:3037] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:54.487478 4935 raft_consensus.cc:2454] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3528b7307e441696cad73158d42d94 in term 1.
I20260810 03:47:54.487908 5016 leader_election.cc:302] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b834d1069964b84ace7aef17fc260ce, da3528b7307e441696cad73158d42d94; no voters:
I20260810 03:47:54.488536 5222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7be1863b19846999270855a45d5a29f" candidate_uuid: "da3528b7307e441696cad73158d42d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "609ca40ab6fc4f04a9979143337d8371"
I20260810 03:47:54.488715 5222 raft_consensus.cc:3037] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:54.490265 5330 raft_consensus.cc:2781] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:47:54.490283 5222 raft_consensus.cc:2454] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da3528b7307e441696cad73158d42d94 in term 1.
I20260810 03:47:54.490566 5330 raft_consensus.cc:686] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 1 LEADER]: Becoming Leader. State: Replica: da3528b7307e441696cad73158d42d94, State: Running, Role: LEADER
I20260810 03:47:54.490990 5330 consensus_queue.cc:237] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } }
I20260810 03:47:54.494817 4765 catalog_manager.cc:5495] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 reported cstate change: term changed from 0 to 1, leader changed from <none> to da3528b7307e441696cad73158d42d94 (127.22.134.194). New cstate: current_term: 1 leader_uuid: "da3528b7307e441696cad73158d42d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da3528b7307e441696cad73158d42d94" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 37595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 } health_report { overall_health: UNKNOWN } } }
W20260810 03:47:54.501031 5287 tablet.cc:2369] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:47:54.551719 5321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.545830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39540 (local address 127.22.134.194:37595)
0810 03:47:54.545970 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:54.545975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:54.546129 (+ 154us) server_negotiation.cc:407] Connection header received
0810 03:47:54.546322 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:54.546326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:54.546408 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:54.546566 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:47:54.546899 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.547773 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.549169 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:54.549513 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:54.549645 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:54.550176 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:47:54.550796 (+ 620us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:47:54.550922 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:54.551327 (+ 405us) server_negotiation.cc:299] Negotiation successful
0810 03:47:54.551400 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:47:54.560598 5222 raft_consensus.cc:1261] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 1 FOLLOWER]: Refusing update from remote peer da3528b7307e441696cad73158d42d94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:47:54.560598 4935 raft_consensus.cc:1261] T a7be1863b19846999270855a45d5a29f P 5b834d1069964b84ace7aef17fc260ce [term 1 FOLLOWER]: Refusing update from remote peer da3528b7307e441696cad73158d42d94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:47:54.561606 5330 consensus_queue.cc:1035] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b834d1069964b84ace7aef17fc260ce" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 38793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:47:54.562121 5343 consensus_queue.cc:1035] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "609ca40ab6fc4f04a9979143337d8371" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:47:54.575878 5346 mvcc.cc:205] Tried to move back new op lower bound from 7316822730990542848 to 7316822730718715904. Current Snapshot: MvccSnapshot[applied={T|T < 7316822730990542848}]
I20260810 03:47:54.580803 5347 mvcc.cc:205] Tried to move back new op lower bound from 7316822730990542848 to 7316822730718715904. Current Snapshot: MvccSnapshot[applied={T|T < 7316822730990542848}]
I20260810 03:47:54.582001 5348 mvcc.cc:205] Tried to move back new op lower bound from 7316822730990542848 to 7316822730718715904. Current Snapshot: MvccSnapshot[applied={T|T < 7316822730990542848}]
I20260810 03:47:54.589922 4765 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:47:54.590179 4765 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:47:54.593642 4765 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a47aa83c94494dc887d2f88cffe180a1: Sending DeleteTablet for 3 replicas of tablet a7be1863b19846999270855a45d5a29f
I20260810 03:47:54.595609 4915 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be1863b19846999270855a45d5a29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:47:54 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:45858
I20260810 03:47:54.596603 5214 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be1863b19846999270855a45d5a29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:47:54 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:50248
I20260810 03:47:54.597633 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 4808
I20260810 03:47:54.607789 5065 tablet_service.cc:1514] Processing DeleteTablet for tablet a7be1863b19846999270855a45d5a29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:47:54 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:39530
I20260810 03:47:54.609601 5363 tablet_replica.cc:330] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: stopping tablet replica
I20260810 03:47:54.610010 5363 raft_consensus.cc:2229] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:47:54.610532 5363 raft_consensus.cc:2258] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:47:54.618533 5362 tablet_replica.cc:330] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: stopping tablet replica
I20260810 03:47:54.618992 5362 raft_consensus.cc:2229] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:47:54.619426 5362 raft_consensus.cc:2258] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:47:54.620568 5363 ts_tablet_manager.cc:1905] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:47:54.622413 5362 ts_tablet_manager.cc:1905] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:47:54.628034 5363 ts_tablet_manager.cc:1918] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:47:54.628212 5363 log.cc:1196] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/a7be1863b19846999270855a45d5a29f
I20260810 03:47:54.628644 5363 ts_tablet_manager.cc:1939] T a7be1863b19846999270855a45d5a29f P da3528b7307e441696cad73158d42d94: Deleting consensus metadata
I20260810 03:47:54.630332 4749 catalog_manager.cc:4841] TS da3528b7307e441696cad73158d42d94 (127.22.134.194:37595): tablet a7be1863b19846999270855a45d5a29f (table test-table [id=7d9946e20ea34ff0a1f69949c1d3cb97]) successfully deleted
I20260810 03:47:54.632015 5362 ts_tablet_manager.cc:1918] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:47:54.632170 5362 log.cc:1196] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/a7be1863b19846999270855a45d5a29f
I20260810 03:47:54.632616 5362 ts_tablet_manager.cc:1939] T a7be1863b19846999270855a45d5a29f P 609ca40ab6fc4f04a9979143337d8371: Deleting consensus metadata
W20260810 03:47:54.633747 4752 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:38793 (error 108)
I20260810 03:47:54.634927 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 4994
I20260810 03:47:54.648497 4750 catalog_manager.cc:4841] TS 609ca40ab6fc4f04a9979143337d8371 (127.22.134.195:33821): tablet a7be1863b19846999270855a45d5a29f (table test-table [id=7d9946e20ea34ff0a1f69949c1d3cb97]) successfully deleted
I20260810 03:47:54.654206 5320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:54.649489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:38793 (local address 127.0.0.1:45862)
0810 03:47:54.653954 (+ 4465us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:54.654075 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:38793: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4335}
W20260810 03:47:54.655462 4752 catalog_manager.cc:4584] TS 5b834d1069964b84ace7aef17fc260ce (127.22.134.193:38793): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a7be1863b19846999270855a45d5a29f: Network error: Client connection negotiation failed: client connection to 127.22.134.193:38793: connect: Connection refused (error 111)
I20260810 03:47:54.663445 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 5142
I20260810 03:47:54.673862 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 4727
I20260810 03:47:54.686112 23067 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 03:47:55.032047 23067 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 03:47:55.032238 23067 mini_ranger.cc:66] Stopping Ranger...
I20260810 03:47:55.378377 23067 mini_ranger.cc:68] Stopped Ranger
2026-08-10 03:47:55.378 UTC [3665] LOG: received smart shutdown request
2026-08-10 03:47:55.383 UTC [3665] LOG: background worker "logical replication launcher" (PID 3674) exited with exit code 1
2026-08-10 03:47:55.384 UTC [3669] LOG: shutting down
2026-08-10 03:47:55.599 UTC [3665] LOG: database system is shut down
2026-08-10T03:47:55Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52201 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:47:55 dist-test-slave-qg60 krb5kdc[5381](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:47:55 dist-test-slave-qg60 krb5kdc[5381](info): set up 2 sockets
Aug 10 03:47:55 dist-test-slave-qg60 krb5kdc[5381](info): commencing operation
krb5kdc: starting...
W20260810 03:47:56.938231 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:47:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:47:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:47:57.089187 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35657
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:35657,127.22.134.253:39083,127.22.134.252:37135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:47:57.241495 5394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:57.241910 5394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:57.242007 5394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:57.247108 5394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:47:57.247228 5394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:57.247272 5394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:57.247319 5394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:47:57.247364 5394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:47:57.254628 5394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:35657,127.22.134.253:39083,127.22.134.252:37135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:57.256345 5394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:57.257699 5394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:57.271859 5402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:57.271859 5399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:57.271871 5400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:57.272156 5394 server_base.cc:1034] running on GCE node
I20260810 03:47:57.272936 5394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:57.274271 5394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:57.275478 5394 hybrid_clock.cc:648] HybridClock initialized: now 1786333677275459 us; error 38 us; skew 500 ppm
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:57.279683 5394 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:47:57.281759 5394 webserver.cc:460] Webserver started at http://127.22.134.254:42535/ using document root <none> and password file <none>
I20260810 03:47:57.282430 5394 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:57.282522 5394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:57.282752 5394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:47:57.285274 5394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "8ddb86fc66f5429ebf023aaca1655d9c"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "35d182b8fbe7f77a9489dfc9495fcba3"
server_key_iv: "d64d7daf78e4866f4be1234c5fcd1135"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.285959 5394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "8ddb86fc66f5429ebf023aaca1655d9c"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "35d182b8fbe7f77a9489dfc9495fcba3"
server_key_iv: "d64d7daf78e4866f4be1234c5fcd1135"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.290982 5394 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 03:47:57.295382 5409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:57.297106 5394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:47:57.297389 5394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "8ddb86fc66f5429ebf023aaca1655d9c"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "35d182b8fbe7f77a9489dfc9495fcba3"
server_key_iv: "d64d7daf78e4866f4be1234c5fcd1135"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.297564 5394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:57.319459 5394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:57.323705 5394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:57.324186 5394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:57.334749 5394 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:35657
I20260810 03:47:57.335309 5468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:35657 every 8 connection(s)
I20260810 03:47:57.336786 5394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:47:57.339584 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 5394
I20260810 03:47:57.339782 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:47:57.340274 23067 external_mini_cluster.cc:1428] Setting key 1ffba892d1cddd50bea3f5e36375e189
I20260810 03:47:57.342397 5469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:57.350639 5469 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.134.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.253@KRBTEST.COM" created.
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:57.372259 5473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.353916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42806 (local address 127.22.134.254:35657)
0810 03:47:57.354580 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.354601 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.354834 (+ 233us) server_negotiation.cc:407] Connection header received
0810 03:47:57.356274 (+ 1440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.356284 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.356538 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.356808 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.357938 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.359386 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.361172 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.361839 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.362040 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.365836 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.365843 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.365857 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.365881 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.368336 (+ 2455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.369031 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.369037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.369038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.369165 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.369538 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.369544 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.369550 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.370013 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.370191 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.370612 (+ 421us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.370910 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":493,"spinlock_wait_cycles":100224,"thread_start_us":285,"threads_started":1}
I20260810 03:47:57.372259 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.353913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35657 (local address 127.0.0.1:42806)
0810 03:47:57.354651 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.354714 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:57.355792 (+ 1078us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:57.356823 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:57.356831 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:57.357381 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:57.357765 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.357781 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.359544 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.359549 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.360986 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.361029 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.362025 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.362027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.362203 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.362947 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:57.362964 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:57.365619 (+ 2655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:57.368502 (+ 2883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.368513 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.368525 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.368872 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.369280 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.369283 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.369285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.369420 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.370152 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:57.370160 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:57.370327 (+ 167us) client_negotiation.cc:769] Sending connection context
0810 03:47:57.370528 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 03:47:57.370970 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":119,"thread_start_us":244,"threads_started":1}
I20260810 03:47:57.375123 5469 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab.
Entry for principal kudu/127.22.134.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab.
I20260810 03:47:57.376446 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.375762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46220)
0810 03:47:57.376053 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.376338 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 03:47:57.376894 5413 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
I20260810 03:47:57.377813 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.253:39083
--webserver_interface=127.22.134.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab
--principal=kudu/127.22.134.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:35657,127.22.134.253:39083,127.22.134.252:37135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:47:57.378652 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.378337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46232)
0810 03:47:57.378481 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.378541 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260810 03:47:57.378993 5469 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:39083: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
I20260810 03:47:57.428433 5469 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } attempt: 1
I20260810 03:47:57.429629 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.429131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46234)
0810 03:47:57.429330 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.429411 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260810 03:47:57.430982 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.430562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46238)
0810 03:47:57.430762 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.430871 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260810 03:47:57.431205 5469 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:39083: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
I20260810 03:47:57.499574 5469 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } attempt: 2
I20260810 03:47:57.500660 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.500192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46250)
0810 03:47:57.500416 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.500540 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260810 03:47:57.501593 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.501342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46264)
0810 03:47:57.501466 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.501519 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260810 03:47:57.501860 5469 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:39083: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
W20260810 03:47:57.524886 5477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:57.525218 5477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:57.525262 5477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:57.529505 5477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:47:57.529582 5477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:57.529603 5477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:57.529621 5477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:47:57.529637 5477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:47:57.535195 5477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:35657,127.22.134.253:39083,127.22.134.252:37135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab
--principal=kudu/127.22.134.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.253:39083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.134.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:57.536404 5477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:57.537598 5477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:47:57.551721 5485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:57.551837 5487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:57.551721 5484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:57.552227 5477 server_base.cc:1034] running on GCE node
I20260810 03:47:57.553290 5477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:57.554891 5477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:57.556208 5477 hybrid_clock.cc:648] HybridClock initialized: now 1786333677556189 us; error 40 us; skew 500 ppm
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:57.560082 5477 init.cc:377] Logged in from keytab as kudu/127.22.134.253@KRBTEST.COM (short username kudu)
I20260810 03:47:57.561276 5477 webserver.cc:460] Webserver started at http://127.22.134.253:38157/ using document root <none> and password file <none>
I20260810 03:47:57.561906 5477 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:57.561976 5477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:57.562167 5477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:47:57.564405 5477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/data/instance:
uuid: "8f6ef931d99145a09c6c7171b49a4a6e"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "4186730838ae5806dd5a0b13916ae161"
server_key_iv: "fd7c2aaa0d6636470fab7228e7e57756"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.565088 5477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/wal/instance:
uuid: "8f6ef931d99145a09c6c7171b49a4a6e"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "4186730838ae5806dd5a0b13916ae161"
server_key_iv: "fd7c2aaa0d6636470fab7228e7e57756"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.569361 5477 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 03:47:57.572032 5495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:57.573473 5477 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:47:57.573617 5477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/wal
uuid: "8f6ef931d99145a09c6c7171b49a4a6e"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "4186730838ae5806dd5a0b13916ae161"
server_key_iv: "fd7c2aaa0d6636470fab7228e7e57756"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.573740 5477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:57.593050 5469 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } attempt: 3
I20260810 03:47:57.594038 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.593711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46274)
0810 03:47:57.593876 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.593947 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260810 03:47:57.594882 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.594653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46278)
0810 03:47:57.594765 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.594821 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:47:57.595073 5469 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:39083: Network error: Client connection negotiation failed: client connection to 127.22.134.253:39083: connect: Connection refused (error 111)
I20260810 03:47:57.601325 5477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:57.605125 5477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:57.605356 5477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:57.612831 5477 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.253:39083
I20260810 03:47:57.613148 5556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.253:39083 every 8 connection(s)
I20260810 03:47:57.613903 5477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
I20260810 03:47:57.616884 5557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:57.619658 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 5477
I20260810 03:47:57.619830 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-1/wal/instance
I20260810 03:47:57.620149 23067 external_mini_cluster.cc:1428] Setting key 6bac59221284722cf7702139bb40cb4b
I20260810 03:47:57.621150 5557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.134.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.252@KRBTEST.COM" created.
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:57.638761 5473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.623280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42818 (local address 127.22.134.254:35657)
0810 03:47:57.623426 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.623430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.624669 (+ 1239us) server_negotiation.cc:407] Connection header received
0810 03:47:57.625852 (+ 1183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.625856 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.625924 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.626040 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.627450 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.628315 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.629765 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.630035 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.630174 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.634081 (+ 3907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.634085 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.634087 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.634117 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.635963 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.636652 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.636656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.636657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.636812 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.637325 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.637328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.637330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.637582 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.637706 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.638395 (+ 689us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.638559 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:47:57.639698 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.623868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35657 (local address 127.0.0.1:42818)
0810 03:47:57.624446 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.624506 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:57.625601 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:57.626325 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:57.626332 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:57.626724 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:57.627268 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.627282 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.628478 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.628481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.629611 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.629623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.630225 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.630230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.630434 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.631162 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:57.631181 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:57.633856 (+ 2675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:57.636141 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.636150 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.636171 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.636506 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.636924 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.636927 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.636930 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.637198 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.637707 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:57.637716 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:57.638056 (+ 340us) client_negotiation.cc:769] Sending connection context
0810 03:47:57.638315 (+ 259us) client_negotiation.cc:240] Negotiation successful
0810 03:47:57.638708 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":171,"threads_started":1}
I20260810 03:47:57.641487 5557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab.
Entry for principal kudu/127.22.134.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab.
I20260810 03:47:57.652235 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.642170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46282)
0810 03:47:57.642308 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.642332 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:57.642432 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:57.643130 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:57.643134 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:57.643337 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:57.643424 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.643430 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.644532 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.644538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.645196 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.645205 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.645845 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.645848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.646023 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.646623 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:57.646649 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:57.647988 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:57.650408 (+ 2420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.650411 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.650413 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.650622 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.650990 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.650993 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.650995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.651090 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.651591 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:57.651594 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:57.651764 (+ 170us) client_negotiation.cc:769] Sending connection context
0810 03:47:57.651906 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 03:47:57.652043 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":56}
I20260810 03:47:57.652716 5562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.642282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46282 (local address 127.22.134.253:39083)
0810 03:47:57.642614 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.642629 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.642649 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:47:57.642685 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.642689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.642863 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.643171 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.643566 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.644410 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.645321 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.645716 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.645831 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.648188 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.648197 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.648210 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.648232 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.650272 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.650787 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.650792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.650794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.650882 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.651174 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.651177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.651178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.651466 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.651613 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.652338 (+ 725us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.652529 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":234,"thread_start_us":105,"threads_started":1}
I20260810 03:47:57.653316 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.252:37135
--webserver_interface=127.22.134.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab
--principal=kudu/127.22.134.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:36655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:35657,127.22.134.253:39083,127.22.134.252:37135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:47:57.654958 5557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:47:57.655870 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.655561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43702)
0810 03:47:57.655727 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.655811 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260810 03:47:57.656226 5496 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
I20260810 03:47:57.657420 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.657113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43704)
0810 03:47:57.657268 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.657335 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260810 03:47:57.657613 5557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:37135: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
I20260810 03:47:57.706924 5557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } attempt: 1
I20260810 03:47:57.707958 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.707543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43720)
0810 03:47:57.707750 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.707844 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260810 03:47:57.708865 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.708561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43730)
0810 03:47:57.708694 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.708792 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260810 03:47:57.709060 5557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:37135: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
I20260810 03:47:57.738317 5469 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } attempt: 4
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
I20260810 03:47:57.749053 5562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.739185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46294 (local address 127.22.134.253:39083)
0810 03:47:57.739379 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.739386 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.739415 (+ 29us) server_negotiation.cc:407] Connection header received
0810 03:47:57.739609 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.739612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.739672 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.739780 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.740291 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.740914 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.742365 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.742677 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.742810 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.745055 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.745059 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.745062 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.745097 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.747252 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.747721 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.747724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.747726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.747813 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.748102 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.748107 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.748116 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.748309 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.748420 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.748699 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.748866 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 03:47:57.749053 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.739073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46294)
0810 03:47:57.739338 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.739360 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:57.739466 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:57.739823 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:57.739825 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:57.740006 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:57.740150 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.740157 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.741034 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.741041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.742201 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.742214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.742820 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.742824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.742933 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.743511 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:57.743525 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:57.744900 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:57.747388 (+ 2488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.747392 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.747394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.747607 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.747911 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.747914 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.747916 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.748009 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.748411 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:57.748414 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:57.748523 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 03:47:57.748644 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 03:47:57.748857 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152}
I20260810 03:47:57.749993 5469 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:47:57.750869 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.750578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43742)
0810 03:47:57.750718 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.750784 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 03:47:57.751708 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.751434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43748)
0810 03:47:57.751598 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.751651 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260810 03:47:57.751919 5469 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:37135: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
I20260810 03:47:57.777313 5557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } attempt: 2
I20260810 03:47:57.778303 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.777898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43754)
0810 03:47:57.778048 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.778221 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 03:47:57.779351 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.779074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43758)
0810 03:47:57.779216 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.779283 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260810 03:47:57.779553 5557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:37135: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
W20260810 03:47:57.782409 5563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:47:57.782685 5563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:47:57.782768 5563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:47:57.787010 5563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:47:57.787081 5563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:47:57.787102 5563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:47:57.787120 5563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:47:57.787177 5563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:47:57.793028 5563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:36655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:35657,127.22.134.253:39083,127.22.134.252:37135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab
--principal=kudu/127.22.134.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.252:37135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.134.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:47:57.794253 5563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:47:57.795336 5563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:47:57.804802 5563 server_base.cc:1034] running on GCE node
W20260810 03:47:57.804713 5570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:57.804713 5569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:47:57.804956 5572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:47:57.805577 5563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:47:57.806789 5563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:47:57.808009 5563 hybrid_clock.cc:648] HybridClock initialized: now 1786333677807965 us; error 62 us; skew 500 ppm
I20260810 03:47:57.811254 5469 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } attempt: 1
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:47:57.812243 5563 init.cc:377] Logged in from keytab as kudu/127.22.134.252@KRBTEST.COM (short username kudu)
I20260810 03:47:57.812311 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.811947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43768)
0810 03:47:57.812159 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.812225 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260810 03:47:57.813289 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.812991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43770)
0810 03:47:57.813115 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.813175 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 03:47:57.813439 5469 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:37135: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
I20260810 03:47:57.813629 5563 webserver.cc:460] Webserver started at http://127.22.134.252:37643/ using document root <none> and password file <none>
I20260810 03:47:57.814406 5563 fs_manager.cc:359] Metadata directory not provided
I20260810 03:47:57.814489 5563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:47:57.814689 5563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:47:57.817351 5563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/data/instance:
uuid: "259f5aeee0f34244a593865ee60f4891"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "efbca62276fb2b46dd72af9ce77b7bcd"
server_key_iv: "9f76823b955527951fea4163e9815d6e"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.817983 5563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/wal/instance:
uuid: "259f5aeee0f34244a593865ee60f4891"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "efbca62276fb2b46dd72af9ce77b7bcd"
server_key_iv: "9f76823b955527951fea4163e9815d6e"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.822602 5563 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:47:57.825592 5579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:47:57.827262 5563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:47:57.827422 5563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/wal
uuid: "259f5aeee0f34244a593865ee60f4891"
format_stamp: "Formatted at 2026-08-10 03:47:57 on dist-test-slave-qg60"
server_key: "efbca62276fb2b46dd72af9ce77b7bcd"
server_key_iv: "9f76823b955527951fea4163e9815d6e"
server_key_version: "encryptionkey@0"
I20260810 03:47:57.827622 5563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:47:57.860846 5563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:47:57.865000 5563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:47:57.865262 5563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:47:57.870751 5557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } attempt: 3
I20260810 03:47:57.871872 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.871491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43780)
0810 03:47:57.871686 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.871765 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260810 03:47:57.872915 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.872488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43790)
0810 03:47:57.872704 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.872817 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
W20260810 03:47:57.873127 5557 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:37135: Network error: Client connection negotiation failed: client connection to 127.22.134.252:37135: connect: Connection refused (error 111)
I20260810 03:47:57.874336 5563 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.252:37135
I20260810 03:47:57.874666 5637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.252:37135 every 8 connection(s)
I20260810 03:47:57.875586 5563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
I20260810 03:47:57.878970 5638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:47:57.880643 5469 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } attempt: 2
I20260810 03:47:57.883071 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 5563
I20260810 03:47:57.883224 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786333502007595-23067-0/minicluster-data/master-2/wal/instance
I20260810 03:47:57.883563 23067 external_mini_cluster.cc:1428] Setting key c5968c085cd1016cf75885b6cd5151e7
I20260810 03:47:57.884040 5638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:57.898379 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.881269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43794)
0810 03:47:57.881447 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.881468 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:57.881579 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:57.884319 (+ 2740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:57.884322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:57.884584 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:57.884780 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.884793 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.887451 (+ 2658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.887455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.888361 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.888371 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.889924 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.889928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.890036 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.890659 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:57.890678 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:57.893107 (+ 2429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:57.895944 (+ 2837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.895949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.895952 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.896356 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.896793 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.896796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.896798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.896883 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.897776 (+ 893us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:57.897779 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:57.897907 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 03:47:57.898026 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 03:47:57.898183 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":24}
I20260810 03:47:57.898744 5473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.886306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42834 (local address 127.22.134.254:35657)
0810 03:47:57.886451 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.886458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.886856 (+ 398us) server_negotiation.cc:407] Connection header received
0810 03:47:57.887062 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.887069 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.887131 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.887178 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.888180 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.888888 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.890071 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.890610 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.890759 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.893925 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.893930 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.893935 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.893968 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.896355 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.897080 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.897086 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.897088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.897173 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.897439 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.897443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.897445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.897720 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.897823 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.898342 (+ 519us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.898463 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":55}
I20260810 03:47:57.899571 5641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.884320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43796 (local address 127.22.134.252:37135)
0810 03:47:57.885135 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.885145 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.885161 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:47:57.885200 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.885203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.885248 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.885349 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.886432 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.887317 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.888282 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.889345 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.889598 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.893275 (+ 3677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.893284 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.893302 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.893336 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.896934 (+ 3598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.897521 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.897524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.897526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.897611 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.897938 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.897942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.897943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.898144 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.899175 (+ 1031us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.899239 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.899331 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":215,"server-negotiator.queue_time_us":727,"spinlock_wait_cycles":17664,"thread_start_us":112,"threads_started":1}
I20260810 03:47:57.899577 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.882033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43794 (local address 127.22.134.252:37135)
0810 03:47:57.882526 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.882550 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.882599 (+ 49us) server_negotiation.cc:407] Connection header received
0810 03:47:57.883426 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.883448 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.883903 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.885022 (+ 1119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.885427 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.887291 (+ 1864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.888487 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.889345 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.889595 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.893320 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.893324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.893326 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.893347 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.895809 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.896479 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.896485 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.896522 (+ 37us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.896656 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.896981 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.896986 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.896987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.897626 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.897793 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.898164 (+ 371us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.898494 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":168,"server-negotiator.queue_time_us":337,"spinlock_wait_cycles":12416,"thread_start_us":174,"threads_started":1}
I20260810 03:47:57.899580 5644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.886296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35657 (local address 127.0.0.1:42834)
0810 03:47:57.886722 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.886777 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:57.886944 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:57.887340 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:57.887344 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:57.887869 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:57.888027 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.888034 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.889017 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.889023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.889933 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.889944 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.890816 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.890820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.890944 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.891482 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:57.891499 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:57.893750 (+ 2251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:57.896502 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.896512 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.896522 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.896965 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.897268 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.897271 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.897272 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.897340 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.897884 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:57.897893 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:57.898085 (+ 192us) client_negotiation.cc:769] Sending connection context
0810 03:47:57.898885 (+ 800us) client_negotiation.cc:240] Negotiation successful
0810 03:47:57.899225 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"spinlock_wait_cycles":3968,"thread_start_us":156,"threads_started":1}
I20260810 03:47:57.900967 5638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:47:57.904486 5469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c: Bootstrap starting.
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:47:57.907783 5469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:57.908915 5469 log.cc:824] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:57.911576 5469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c: No bootstrap required, opened a new log
I20260810 03:47:57.912633 5473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.902372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42848 (local address 127.22.134.254:35657)
0810 03:47:57.902491 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.902495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.902507 (+ 12us) server_negotiation.cc:407] Connection header received
0810 03:47:57.902674 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.902677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.902717 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.902787 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.903600 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.904088 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.905184 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.905524 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.905629 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.908400 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.908403 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.908406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.908434 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.910735 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.911255 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.911258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.911260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.911355 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.911647 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.911651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.911653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.911887 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.912071 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.912342 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.912469 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:47:57.915760 5469 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:57.915995 5469 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:57.916074 5469 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ddb86fc66f5429ebf023aaca1655d9c, State: Initialized, Role: FOLLOWER
I20260810 03:47:57.916589 5469 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:57.917141 5648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:57.917373 5648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:47:57.918212 5469 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:47:57.918576 5562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.901594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46296 (local address 127.22.134.253:39083)
0810 03:47:57.901748 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.901753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.901772 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:47:57.901919 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.901922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.901979 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.902077 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.902589 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.903400 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.904433 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.904813 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.904918 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.907275 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.907279 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.907282 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.907310 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.909386 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.916983 (+ 7597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.916987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.916989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.917120 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.917541 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.917544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.917546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.917788 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.917896 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.918284 (+ 388us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.918419 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:47:57.919358 5644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.901496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:39083 (local address 127.0.0.1:46296)
0810 03:47:57.901725 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.901741 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:57.901817 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:57.902109 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:57.902112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:57.902291 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:57.902419 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.902430 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.903528 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.903531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.904289 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.904299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.904935 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.904939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.905039 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.905578 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:57.905592 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:57.907108 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:57.909502 (+ 2394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.909508 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.909511 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.909782 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.917277 (+ 7495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.917283 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.917285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.917410 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.917955 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:57.917959 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:57.918072 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 03:47:57.918932 (+ 860us) client_negotiation.cc:240] Negotiation successful
0810 03:47:57.919130 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158}
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
I20260810 03:47:57.920252 5638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } has no permanent_uuid. Determining permanent_uuid...
W20260810 03:47:57.923838 5659 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:47:57.923921 5659 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:47:57.925787 5647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.914187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46312 (local address 127.22.134.253:39083)
0810 03:47:57.914565 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.914572 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.914585 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:47:57.914623 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.914625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.914665 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.914749 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.915565 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.916299 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.917333 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.917665 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.917779 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.921259 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.921264 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.921266 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.921294 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.923280 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.923802 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.923806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.923808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.923892 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.924226 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.924230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.924232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.924476 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.924669 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.925447 (+ 778us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.925591 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":155,"threads_started":1}
Aug 10 03:47:57 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
I20260810 03:47:57.924402 5394 master_runner.cc:186] Error getting master registration for 127.22.134.253:39083: OK, instance_id { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" instance_seqno: 1786333677610785 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:47:57.928146 5394 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:47:57.930717 5644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.920801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43810)
0810 03:47:57.921006 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:57.921019 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:57.921091 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:57.921568 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:57.921571 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:57.921746 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:57.921826 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.921833 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.922811 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.922813 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.923541 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:57.923551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.924221 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.924224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:57.924293 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.924765 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:57.924782 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:57.926676 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:57.928864 (+ 2188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.928868 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.928870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.929162 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.929477 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:57.929480 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:57.929483 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:57.929592 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:57.930115 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:57.930118 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:57.930223 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 03:47:57.930338 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 03:47:57.930503 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260810 03:47:57.930730 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.921221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43810 (local address 127.22.134.252:37135)
0810 03:47:57.921319 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.921324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.921335 (+ 11us) server_negotiation.cc:407] Connection header received
0810 03:47:57.921367 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.921369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.921408 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.921478 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.921948 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.922682 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.923664 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.923995 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.924098 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.926843 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.926849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.926853 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.926881 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.928672 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.929272 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.929275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.929277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.929365 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.929704 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.929708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.929710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.929992 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.930093 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.930383 (+ 290us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.930594 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":101,"server-negotiator.queue_time_us":40}
I20260810 03:47:57.932090 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:47:57.935159 5638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891: Bootstrap starting.
I20260810 03:47:57.938601 5638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:57.939845 5638 log.cc:824] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:57.946997 5647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.935871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46314 (local address 127.22.134.253:39083)
0810 03:47:57.936126 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.936131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.936372 (+ 241us) server_negotiation.cc:407] Connection header received
0810 03:47:57.936542 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.936545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.936595 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.936648 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.937980 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.938812 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.940149 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.940511 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.940591 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.942757 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.942775 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.942778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.942812 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.945072 (+ 2260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.945603 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.945607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.945609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.945700 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.945989 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.945993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.945995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.946220 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.946324 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.946687 (+ 363us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.946823 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165}
I20260810 03:47:57.948299 5473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.934745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42864 (local address 127.22.134.254:35657)
0810 03:47:57.934861 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.934866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.935468 (+ 602us) server_negotiation.cc:407] Connection header received
0810 03:47:57.935679 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.935682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.935733 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.935783 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.937133 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.937873 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.940988 (+ 3115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.941332 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.941436 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.943617 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.943621 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.943623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.943654 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.945701 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.946278 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.946282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.946284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.946378 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.946701 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.946706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.946710 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.946976 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.947108 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.947973 (+ 865us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.948131 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 03:47:57.948395 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:57.935984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43820 (local address 127.22.134.252:37135)
0810 03:47:57.936092 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:57.936096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:57.937966 (+ 1870us) server_negotiation.cc:407] Connection header received
0810 03:47:57.938009 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:57.938012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:57.938057 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:57.938134 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:57.939957 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.940592 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.941958 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:57.942338 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:57.942579 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:57.944683 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:57.944691 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:57.944700 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:57.944767 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:57.946542 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.947022 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.947028 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.947032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.947137 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:57.947458 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:57.947461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:57.947463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:57.947690 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:57.947798 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:57.948140 (+ 342us) server_negotiation.cc:299] Negotiation successful
0810 03:47:57.948249 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 03:47:57.954795 5638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891: No bootstrap required, opened a new log
I20260810 03:47:57.958480 5638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:57.958813 5638 raft_consensus.cc:374] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:57.958901 5638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 259f5aeee0f34244a593865ee60f4891, State: Initialized, Role: FOLLOWER
I20260810 03:47:57.959372 5638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:57.959942 5672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:57.960098 5672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:47:57.960808 5638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 03:47:57.968396 5687 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:47:57.968550 5687 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:47:57.968357 5563 master_runner.cc:186] Error getting master registration for 127.22.134.253:39083: OK, instance_id { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" instance_seqno: 1786333677610785 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:47:57.971395 5563 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:47:57.982882 5648 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:47:57.983114 5648 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:57.984220 5648 leader_election.cc:288] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f6ef931d99145a09c6c7171b49a4a6e (127.22.134.253:39083), 259f5aeee0f34244a593865ee60f4891 (127.22.134.252:37135)
I20260810 03:47:57.984982 5608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259f5aeee0f34244a593865ee60f4891" is_pre_election: true
I20260810 03:47:57.985330 5608 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb86fc66f5429ebf023aaca1655d9c in term 0.
I20260810 03:47:57.985818 5410 leader_election.cc:302] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 259f5aeee0f34244a593865ee60f4891, 8ddb86fc66f5429ebf023aaca1655d9c; no voters:
I20260810 03:47:57.986121 5648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:47:57.986219 5648 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:47:57.986263 5648 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:57.987635 5648 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:57.988379 5648 leader_election.cc:288] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [CANDIDATE]: Term 1 election: Requested vote from peers 8f6ef931d99145a09c6c7171b49a4a6e (127.22.134.253:39083), 259f5aeee0f34244a593865ee60f4891 (127.22.134.252:37135)
I20260810 03:47:57.988843 5608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259f5aeee0f34244a593865ee60f4891"
I20260810 03:47:57.988996 5608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:57.990440 5608 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb86fc66f5429ebf023aaca1655d9c in term 1.
I20260810 03:47:57.991143 5410 leader_election.cc:302] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 259f5aeee0f34244a593865ee60f4891, 8ddb86fc66f5429ebf023aaca1655d9c; no voters:
I20260810 03:47:57.991443 5648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:47:57.992225 5648 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [term 1 LEADER]: Becoming Leader. State: Replica: 8ddb86fc66f5429ebf023aaca1655d9c, State: Running, Role: LEADER
I20260810 03:47:57.992650 5648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:57.995463 5690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ddb86fc66f5429ebf023aaca1655d9c. Latest consensus state: current_term: 1 leader_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:57.995600 5690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: This master's current role is: LEADER
I20260810 03:47:57.996248 5693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:47:57.998096 5693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:47:58.004633 5608 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [term 1 FOLLOWER]: Refusing update from remote peer 8ddb86fc66f5429ebf023aaca1655d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:47:58.005609 5690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:47:58.011103 5672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ddb86fc66f5429ebf023aaca1655d9c. Latest consensus state: current_term: 1 leader_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:58.011281 5672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:47:58.016315 5557 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } attempt: 4
Aug 10 03:47:58 dist-test-slave-qg60 krb5kdc[5381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333677, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
I20260810 03:47:58.024250 5690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:58.024425 5690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: This master's current role is: LEADER
I20260810 03:47:58.026114 5672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:58.026266 5672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:47:58.028816 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:58.016815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:37135 (local address 127.0.0.1:43822)
0810 03:47:58.017077 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 03:47:58.017093 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:47:58.017178 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:47:58.017441 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:47:58.017444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:47:58.017679 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:47:58.017792 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:58.017799 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:58.019282 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:58.019287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:58.020204 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:47:58.020217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:47:58.020968 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:47:58.020972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:47:58.021061 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:58.021680 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:47:58.021696 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:47:58.023523 (+ 1827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:47:58.026214 (+ 2691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:58.026218 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:58.026220 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:58.026663 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:58.027023 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:47:58.027026 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:47:58.027028 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:47:58.027650 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:47:58.028201 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:47:58.028204 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:47:58.028327 (+ 123us) client_negotiation.cc:769] Sending connection context
0810 03:47:58.028438 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 03:47:58.028617 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176}
I20260810 03:47:58.030061 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:47:58.017065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43822 (local address 127.22.134.252:37135)
0810 03:47:58.017179 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 03:47:58.017183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:47:58.017203 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:47:58.017274 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:47:58.017280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:47:58.017328 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:47:58.017416 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:47:58.017919 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:58.019152 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:58.020337 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:47:58.020706 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:47:58.020944 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:47:58.023811 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:47:58.023815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:47:58.023818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:47:58.023849 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:47:58.026043 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:58.026796 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:58.026800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:58.026802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:58.026906 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:47:58.027782 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:47:58.027786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:47:58.027787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:47:58.028044 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:47:58.028138 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 03:47:58.029306 (+ 1168us) server_negotiation.cc:299] Negotiation successful
0810 03:47:58.029516 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 03:47:58.033582 5557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e: Bootstrap starting.
I20260810 03:47:58.036542 5557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e: Neither blocks nor log segments found. Creating new log.
I20260810 03:47:58.036876 5693 catalog_manager.cc:1347] Generated new cluster ID: f47474ffa5cf4b9396efdb3a3a540880
I20260810 03:47:58.036842 5695 mvcc.cc:205] Tried to move back new op lower bound from 7316822745097199616 to 7316822745062699008. Current Snapshot: MvccSnapshot[applied={T|T < 7316822745097199616 or (T in {7316822745097199616})}]
I20260810 03:47:58.036943 5693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:47:58.045053 5557 log.cc:824] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:47:58.049357 5694 mvcc.cc:205] Tried to move back new op lower bound from 7316822745097199616 to 7316822745062699008. Current Snapshot: MvccSnapshot[applied={T|T < 7316822745097199616 or (T in {7316822745097199616})}]
I20260810 03:47:58.065402 5557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e: No bootstrap required, opened a new log
I20260810 03:47:58.070626 5693 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:47:58.071182 5557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:58.071833 5557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:47:58.072000 5557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f6ef931d99145a09c6c7171b49a4a6e, State: Initialized, Role: FOLLOWER
I20260810 03:47:58.073228 5557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } }
I20260810 03:47:58.073637 5693 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:47:58.076057 5528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" is_pre_election: true
I20260810 03:47:58.076663 5526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:47:58.078585 5526 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [term 1 FOLLOWER]: Refusing update from remote peer 8ddb86fc66f5429ebf023aaca1655d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:47:58.076076 5527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f6ef931d99145a09c6c7171b49a4a6e"
I20260810 03:47:58.081893 5527 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb86fc66f5429ebf023aaca1655d9c in term 1.
I20260810 03:47:58.083784 5690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:47:58.085031 5701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:58.085189 5701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:47:58.087833 5693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c: Generated new TSK 0
I20260810 03:47:58.088646 5693 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:47:58.093724 5702 mvcc.cc:205] Tried to move back new op lower bound from 7316822745323769856 to 7316822745062699008. Current Snapshot: MvccSnapshot[applied={T|T < 7316822745097199616}]
I20260810 03:47:58.094378 5701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ddb86fc66f5429ebf023aaca1655d9c. Latest consensus state: current_term: 1 leader_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:58.094573 5701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:47:58.094687 5701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:58.094774 5701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:47:58.094869 5557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:47:58.096424 5690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ddb86fc66f5429ebf023aaca1655d9c" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35657 } } peers { permanent_uuid: "8f6ef931d99145a09c6c7171b49a4a6e" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 39083 } } peers { permanent_uuid: "259f5aeee0f34244a593865ee60f4891" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 37135 } } }
I20260810 03:47:58.096576 5690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ddb86fc66f5429ebf023aaca1655d9c [sys.catalog]: This master's current role is: LEADER
I20260810 03:47:58.102761 5719 catalog_manager.cc:1259] Loaded cluster ID: f47474ffa5cf4b9396efdb3a3a540880
I20260810 03:47:58.102922 5719 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e: loading cluster ID for follower catalog manager: success
I20260810 03:47:58.107650 5719 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e: acquiring CA information for follower catalog manager: success
I20260810 03:47:58.109704 5719 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8f6ef931d99145a09c6c7171b49a4a6e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:47:58.970060 5687 catalog_manager.cc:1259] Loaded cluster ID: f47474ffa5cf4b9396efdb3a3a540880
I20260810 03:47:58.970166 5687 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891: loading cluster ID for follower catalog manager: success
I20260810 03:47:58.971968 5687 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891: acquiring CA information for follower catalog manager: success
I20260810 03:47:58.973330 5687 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 259f5aeee0f34244a593865ee60f4891: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:47:59.169446 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 5394
I20260810 03:47:59.178839 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 5477
I20260810 03:47:59.188133 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 5563
2026-08-10T03:47:59Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3468 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:47:59 dist-test-slave-qg60 krb5kdc[5729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:47:59 dist-test-slave-qg60 krb5kdc[5729](info): set up 2 sockets
Aug 10 03:47:59 dist-test-slave-qg60 krb5kdc[5729](info): commencing operation
krb5kdc: starting...
W20260810 03:48:00.359961 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:48:00 dist-test-slave-qg60 krb5kdc[5729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:48:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:48:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:48:00.506145 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:34559
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:34559
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:00.632802 5745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:00.633203 5745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:00.633260 5745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:00.637825 5745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:48:00.637904 5745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:00.637924 5745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:00.637943 5745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:48:00.637959 5745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:48:00.643561 5745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:34559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:34559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:00.644670 5745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:00.645718 5745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:00.655306 5752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:00.655294 5754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:00.655360 5745 server_base.cc:1034] running on GCE node
W20260810 03:48:00.655294 5751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:00.656315 5745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:00.657572 5745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:00.658746 5745 hybrid_clock.cc:648] HybridClock initialized: now 1786333680658717 us; error 46 us; skew 500 ppm
Aug 10 03:48:00 dist-test-slave-qg60 krb5kdc[5729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333680, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:00.667315 5745 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:48:00.668429 5745 webserver.cc:460] Webserver started at http://127.22.134.254:43919/ using document root <none> and password file <none>
I20260810 03:48:00.669157 5745 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:00.669269 5745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:00.669533 5745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:00.671767 5745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "c38d10dffcbd4a89863cbd67750424a1"
format_stamp: "Formatted at 2026-08-10 03:48:00 on dist-test-slave-qg60"
server_key: "a45c280b9faa2790ccbfe1e3dbfc70fb"
server_key_iv: "8e4eedb424f8c0cebfc9e2d9838edf9c"
server_key_version: "encryptionkey@0"
I20260810 03:48:00.672399 5745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "c38d10dffcbd4a89863cbd67750424a1"
format_stamp: "Formatted at 2026-08-10 03:48:00 on dist-test-slave-qg60"
server_key: "a45c280b9faa2790ccbfe1e3dbfc70fb"
server_key_iv: "8e4eedb424f8c0cebfc9e2d9838edf9c"
server_key_version: "encryptionkey@0"
I20260810 03:48:00.676543 5745 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 03:48:00.679338 5764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:00.680832 5745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:00.680998 5745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "c38d10dffcbd4a89863cbd67750424a1"
format_stamp: "Formatted at 2026-08-10 03:48:00 on dist-test-slave-qg60"
server_key: "a45c280b9faa2790ccbfe1e3dbfc70fb"
server_key_iv: "8e4eedb424f8c0cebfc9e2d9838edf9c"
server_key_version: "encryptionkey@0"
I20260810 03:48:00.681141 5745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:00.696722 5745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:00.700021 5745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:00.700246 5745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:00.707839 5745 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:34559
I20260810 03:48:00.707867 5819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:34559 every 8 connection(s)
I20260810 03:48:00.708940 5745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:48:00.712021 5820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:00.714743 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 5745
I20260810 03:48:00.714907 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:48:00.715211 23067 external_mini_cluster.cc:1428] Setting key 8e760221b5800dbae695cbc9f1d65ad1
I20260810 03:48:00.718874 5820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1: Bootstrap starting.
I20260810 03:48:00.721364 5820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:00.722209 5820 log.cc:824] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:48:00 dist-test-slave-qg60 krb5kdc[5729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:00.724675 5820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1: No bootstrap required, opened a new log
I20260810 03:48:00.728305 5820 raft_consensus.cc:348] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38d10dffcbd4a89863cbd67750424a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34559 } }
I20260810 03:48:00.728618 5820 raft_consensus.cc:374] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:00.728716 5820 raft_consensus.cc:729] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c38d10dffcbd4a89863cbd67750424a1, State: Initialized, Role: FOLLOWER
I20260810 03:48:00.729249 5820 consensus_queue.cc:260] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38d10dffcbd4a89863cbd67750424a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34559 } }
I20260810 03:48:00.729411 5820 raft_consensus.cc:388] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:48:00.729521 5820 raft_consensus.cc:482] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:48:00.729645 5820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:00.730775 5820 raft_consensus.cc:504] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38d10dffcbd4a89863cbd67750424a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34559 } }
I20260810 03:48:00.731144 5820 leader_election.cc:302] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c38d10dffcbd4a89863cbd67750424a1; no voters:
I20260810 03:48:00.731477 5820 leader_election.cc:288] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:48:00.731637 5827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:48:00.731678 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:00.716770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56276 (local address 127.22.134.254:34559)
0810 03:48:00.717362 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:00.717378 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:00.717414 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:48:00.718067 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:00.718085 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:00.718449 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:00.718801 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:00.719700 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:00.720800 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:00.721774 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:00.722279 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:00.722455 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:00.725615 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:00.725621 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:00.725636 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:00.725666 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:00.728057 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:00.728641 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:00.728648 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:00.728655 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:00.728851 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:00.729172 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:00.729177 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:00.729179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:00.729726 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:00.729951 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:00.730288 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 03:48:00.730633 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":209,"threads_started":1}
I20260810 03:48:00.731863 5827 raft_consensus.cc:686] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [term 1 LEADER]: Becoming Leader. State: Replica: c38d10dffcbd4a89863cbd67750424a1, State: Running, Role: LEADER
I20260810 03:48:00.732165 5827 consensus_queue.cc:237] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38d10dffcbd4a89863cbd67750424a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34559 } }
I20260810 03:48:00.732899 5820 sys_catalog.cc:564] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:48:00.733315 5827 sys_catalog.cc:455] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c38d10dffcbd4a89863cbd67750424a1. Latest consensus state: current_term: 1 leader_uuid: "c38d10dffcbd4a89863cbd67750424a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38d10dffcbd4a89863cbd67750424a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34559 } } }
I20260810 03:48:00.733315 5829 sys_catalog.cc:455] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c38d10dffcbd4a89863cbd67750424a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38d10dffcbd4a89863cbd67750424a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 34559 } } }
I20260810 03:48:00.733462 5827 sys_catalog.cc:458] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:00.733462 5829 sys_catalog.cc:458] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:00.733858 5832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:48:00.735596 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:48:00.737720 5832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:48:00.744297 5832 catalog_manager.cc:1347] Generated new cluster ID: 6e478a3e4fdb4265aee2848b4ca351cf
I20260810 03:48:00.744429 5832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:48:00.757217 5832 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:48:00.758579 5832 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:48:00.767771 5832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c38d10dffcbd4a89863cbd67750424a1: Generated new TSK 0
I20260810 03:48:00.768656 5832 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:48:00.792158 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 5745
2026-08-10T03:48:00Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1601 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:48:00 dist-test-slave-qg60 krb5kdc[5854](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:48:00 dist-test-slave-qg60 krb5kdc[5854](info): set up 2 sockets
Aug 10 03:48:00 dist-test-slave-qg60 krb5kdc[5854](info): commencing operation
krb5kdc: starting...
W20260810 03:48:01.940843 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:48:02 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:48:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:48:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:48:02.081574 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:32969
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:32969
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:02.202615 5870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:02.202908 5870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:02.202950 5870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:02.206946 5870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:48:02.207028 5870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:02.207048 5870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:02.207064 5870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:48:02.207080 5870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:48:02.212669 5870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:32969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:32969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:02.213807 5870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:02.214843 5870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:02.224679 5878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:02.224709 5880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:02.224689 5876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:02.224977 5870 server_base.cc:1034] running on GCE node
I20260810 03:48:02.225654 5870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:02.226936 5870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:02.228163 5870 hybrid_clock.cc:648] HybridClock initialized: now 1786333682228152 us; error 38 us; skew 500 ppm
Aug 10 03:48:02 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333682, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:02.231765 5870 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:48:02.233031 5870 webserver.cc:460] Webserver started at http://127.22.134.254:36557/ using document root <none> and password file <none>
I20260810 03:48:02.233657 5870 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:02.233759 5870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:02.234012 5870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:02.236199 5870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "6ee91d592dc546e8b18a6e363851bf17"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "909d5fd1184ee42255a355656f35a24a"
server_key_iv: "f6542ad9d9020e92cc098c8a2000f089"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.236900 5870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "6ee91d592dc546e8b18a6e363851bf17"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "909d5fd1184ee42255a355656f35a24a"
server_key_iv: "f6542ad9d9020e92cc098c8a2000f089"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.240928 5870 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:48:02.243752 5887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:02.245353 5870 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:02.245509 5870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "6ee91d592dc546e8b18a6e363851bf17"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "909d5fd1184ee42255a355656f35a24a"
server_key_iv: "f6542ad9d9020e92cc098c8a2000f089"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.245666 5870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:02.280580 5870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:02.284297 5870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:02.284552 5870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:02.292064 5870 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:32969
I20260810 03:48:02.292377 5939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:32969 every 8 connection(s)
I20260810 03:48:02.293198 5870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:48:02.296094 5940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:02.300572 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 5870
I20260810 03:48:02.300742 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:48:02.301086 23067 external_mini_cluster.cc:1428] Setting key bab775fb3264ce087f897f4f451f8860
I20260810 03:48:02.302711 5940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Bootstrap starting.
I20260810 03:48:02.305358 5940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:02.306157 5940 log.cc:824] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:02.308157 5940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: No bootstrap required, opened a new log
Aug 10 03:48:02 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:02.312881 5940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:02.313189 5940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:02.313261 5940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee91d592dc546e8b18a6e363851bf17, State: Initialized, Role: FOLLOWER
I20260810 03:48:02.313768 5940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:02.313973 5940 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:48:02.314066 5940 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:48:02.314178 5940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:02.315433 5940 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:02.315790 5940 leader_election.cc:302] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ee91d592dc546e8b18a6e363851bf17; no voters:
I20260810 03:48:02.316133 5940 leader_election.cc:288] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:48:02.316282 5945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:48:02.316504 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:02.302579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43210 (local address 127.22.134.254:32969)
0810 03:48:02.303039 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:02.303057 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:02.303095 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:48:02.303776 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:02.303793 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:02.304139 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:02.304425 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:02.305438 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.306558 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.307433 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.307910 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.308087 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:02.310973 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:02.310979 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:02.310994 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:02.311025 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:02.312998 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:02.313587 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:02.313596 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:02.313604 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:02.313748 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:02.314061 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:02.314064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:02.314067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:02.314577 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:02.314777 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:02.315074 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 03:48:02.315411 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":164,"threads_started":1}
I20260810 03:48:02.316543 5945 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 1 LEADER]: Becoming Leader. State: Replica: 6ee91d592dc546e8b18a6e363851bf17, State: Running, Role: LEADER
I20260810 03:48:02.317157 5945 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:02.317548 5940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:48:02.319073 5948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ee91d592dc546e8b18a6e363851bf17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } } }
I20260810 03:48:02.319216 5948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:02.319146 5946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ee91d592dc546e8b18a6e363851bf17. Latest consensus state: current_term: 1 leader_uuid: "6ee91d592dc546e8b18a6e363851bf17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } } }
I20260810 03:48:02.319347 5946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:02.319674 5958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:48:02.322992 5958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:48:02.329038 5958 catalog_manager.cc:1347] Generated new cluster ID: 70378fb9d5b740a3bb3ec3e6ecad348c
I20260810 03:48:02.329191 5958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:48:02.362534 5958 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:48:02.363619 5958 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:48:02.373301 5958 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Generated new TSK 0
I20260810 03:48:02.374261 5958 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:48:02.416255 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32969
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:02.537187 5968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:02.537498 5968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:02.537550 5968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:02.541852 5968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:02.541923 5968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:02.541986 5968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:48:02.547823 5968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:02.549151 5968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:02.550617 5968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:02.563825 5975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:02.563848 5979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:02.564416 5968 server_base.cc:1034] running on GCE node
W20260810 03:48:02.564622 5973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:02.565284 5968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:02.566040 5968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:02.567242 5968 hybrid_clock.cc:648] HybridClock initialized: now 1786333682567204 us; error 54 us; skew 500 ppm
Aug 10 03:48:02 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333682, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:02.570449 5968 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:48:02.571542 5968 webserver.cc:460] Webserver started at http://127.22.134.193:42483/ using document root <none> and password file <none>
I20260810 03:48:02.572219 5968 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:02.572324 5968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:02.572582 5968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:02.575057 5968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "d72cf8d9fad448c1b991ec6fda139e8b"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "8d337ce3c208c66bdfa93c02ce9a88e1"
server_key_iv: "ae310221123d00edcc18952a7a64ff0c"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.575652 5968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "d72cf8d9fad448c1b991ec6fda139e8b"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "8d337ce3c208c66bdfa93c02ce9a88e1"
server_key_iv: "ae310221123d00edcc18952a7a64ff0c"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.580258 5968 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260810 03:48:02.583146 5987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:02.584813 5968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 03:48:02.584975 5968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "d72cf8d9fad448c1b991ec6fda139e8b"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "8d337ce3c208c66bdfa93c02ce9a88e1"
server_key_iv: "ae310221123d00edcc18952a7a64ff0c"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.585129 5968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:02.600975 5968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:02.604977 5968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:02.605226 5968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:02.605911 5968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:02.606858 5968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:02.606938 5968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:02.607023 5968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:02.607072 5968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:02.617713 5968 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:37913
I20260810 03:48:02.617753 6120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:37913 every 8 connection(s)
I20260810 03:48:02.618944 5968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:48:02.624895 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 5968
I20260810 03:48:02.625070 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:48:02.625406 23067 external_mini_cluster.cc:1428] Setting key a71956c9e822ec41f5831628e4b0a2cb
Aug 10 03:48:02 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333682, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:02.635030 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:02.621107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:32885 (local address 127.22.134.254:32969)
0810 03:48:02.621251 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:02.621254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:02.622242 (+ 988us) server_negotiation.cc:407] Connection header received
0810 03:48:02.623712 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:02.623716 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:02.623773 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:02.623864 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:02.625220 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.625980 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.627404 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.627812 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.627953 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:02.631033 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:02.631036 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:02.631038 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:02.631139 (+ 101us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:02.632796 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:02.633383 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:02.633387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:02.633388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:02.633503 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:02.633863 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:02.633866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:02.633868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:02.634082 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:02.634192 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:02.634720 (+ 528us) server_negotiation.cc:299] Negotiation successful
0810 03:48:02.634859 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:48:02.635946 6123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:02.621607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:32885)
0810 03:48:02.622076 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:02.622131 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:02.623471 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:02.624044 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:02.624050 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:02.624465 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:02.625043 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:02.625058 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.626194 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.626197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:02.627271 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:02.627281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.627983 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.627986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:02.628175 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:02.628852 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:02.628868 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:02.630835 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:02.632926 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:02.632932 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:02.632952 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:02.633271 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:02.633594 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:02.633597 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:02.633599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:02.633755 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:02.634194 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:02.634203 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:02.634474 (+ 271us) client_negotiation.cc:769] Sending connection context
0810 03:48:02.634683 (+ 209us) client_negotiation.cc:240] Negotiation successful
0810 03:48:02.635037 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":116,"threads_started":1}
I20260810 03:48:02.637454 6121 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32969
I20260810 03:48:02.637727 6121 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:02.638294 6121 heartbeater.cc:511] Master 127.22.134.254:32969 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:48:02.639925 5900 ts_manager.cc:194] Registered new tserver with Master: d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913)
I20260810 03:48:02.641391 5900 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:32885
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:48:02.659526 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32969
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:02.779768 6127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:02.780093 6127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:02.780174 6127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:02.784471 6127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:02.784555 6127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:02.784617 6127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:48:02.790406 6127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:02.791514 6127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:02.792695 6127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:02.803601 6133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:02.803488 6134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:02.803638 6136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:02.803844 6127 server_base.cc:1034] running on GCE node
I20260810 03:48:02.804360 6127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:02.805131 6127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:02.806348 6127 hybrid_clock.cc:648] HybridClock initialized: now 1786333682806331 us; error 31 us; skew 500 ppm
Aug 10 03:48:02 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333682, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:02.809466 6127 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:48:02.810416 6127 webserver.cc:460] Webserver started at http://127.22.134.194:41517/ using document root <none> and password file <none>
I20260810 03:48:02.811008 6127 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:02.811102 6127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:02.811354 6127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:02.813648 6127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "c94d6f0e764d461dac8d095737fd8e0a"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "b54ec556968f81e7c4c83bcbc634c1a5"
server_key_iv: "48d89e682fc3fafe79f1dbbca163cadc"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.814280 6127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "c94d6f0e764d461dac8d095737fd8e0a"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "b54ec556968f81e7c4c83bcbc634c1a5"
server_key_iv: "48d89e682fc3fafe79f1dbbca163cadc"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.818540 6127 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:48:02.821355 6143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:02.822669 6127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:02.822813 6127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "c94d6f0e764d461dac8d095737fd8e0a"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "b54ec556968f81e7c4c83bcbc634c1a5"
server_key_iv: "48d89e682fc3fafe79f1dbbca163cadc"
server_key_version: "encryptionkey@0"
I20260810 03:48:02.822942 6127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:02.834921 6127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:02.838112 6127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:02.838320 6127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:02.838933 6127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:02.839767 6127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:02.839814 6127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:02.839883 6127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:02.839916 6127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:02.849452 6127 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:39885
I20260810 03:48:02.849475 6268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:39885 every 8 connection(s)
I20260810 03:48:02.850448 6127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:48:02.857762 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 6127
I20260810 03:48:02.857885 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:48:02.858165 23067 external_mini_cluster.cc:1428] Setting key 9f64ef7cbca5abcdeee211e1ec1eeb8f
Aug 10 03:48:02 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333682, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:02.866146 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:02.852576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:40943 (local address 127.22.134.254:32969)
0810 03:48:02.852785 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:02.852791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:02.853727 (+ 936us) server_negotiation.cc:407] Connection header received
0810 03:48:02.855170 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:02.855173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:02.855229 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:02.855318 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:02.856614 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.857258 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.858669 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.858906 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.859028 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:02.861799 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:02.861806 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:02.861811 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:02.861853 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:02.863416 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:02.864121 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:02.864124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:02.864126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:02.864212 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:02.864719 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:02.864722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:02.864724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:02.865003 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:02.865119 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:02.865857 (+ 738us) server_negotiation.cc:299] Negotiation successful
0810 03:48:02.865984 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:48:02.867470 6273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:02.853023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:40943)
0810 03:48:02.853557 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:02.853602 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:02.854909 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:02.855531 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:02.855539 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:02.855959 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:02.856457 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:02.856471 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.857388 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.857390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:02.858527 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:02.858538 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:02.859076 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:02.859080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:02.859269 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:02.859920 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:02.859938 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:02.861528 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:02.863550 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:02.863561 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:02.863583 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:02.864000 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:02.864314 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:02.864319 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:02.864322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:02.864540 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:02.865139 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:02.865150 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:02.865544 (+ 394us) client_negotiation.cc:769] Sending connection context
0810 03:48:02.865801 (+ 257us) client_negotiation.cc:240] Negotiation successful
0810 03:48:02.866247 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":130,"threads_started":1}
I20260810 03:48:02.868877 6269 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32969
I20260810 03:48:02.869279 6269 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:48:02.869876 6269 heartbeater.cc:511] Master 127.22.134.254:32969 requested a full tablet report, sending...
I20260810 03:48:02.871121 5900 ts_manager.cc:194] Registered new tserver with Master: c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885)
I20260810 03:48:02.871865 5900 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:40943
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:48:02.892275 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32969
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:03.012298 6277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:03.012612 6277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:03.012660 6277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:03.016944 6277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:03.017030 6277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:03.017097 6277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:48:03.023267 6277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:03.024415 6277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:03.025864 6277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:03.037225 6282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:03.037256 6283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:03.037213 6285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:03.037632 6277 server_base.cc:1034] running on GCE node
I20260810 03:48:03.038265 6277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:03.039083 6277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:03.040307 6277 hybrid_clock.cc:648] HybridClock initialized: now 1786333683040266 us; error 57 us; skew 500 ppm
Aug 10 03:48:03 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:03.043947 6277 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:48:03.045188 6277 webserver.cc:460] Webserver started at http://127.22.134.195:42793/ using document root <none> and password file <none>
I20260810 03:48:03.045830 6277 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:03.045930 6277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:03.046192 6277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:03.048475 6277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "25849052e18a477cbd377b52cb5e8747"
format_stamp: "Formatted at 2026-08-10 03:48:03 on dist-test-slave-qg60"
server_key: "6638cb0441efc11ef8e3f1df24ac9a85"
server_key_iv: "5989fccf84d9f90ab7cab1bacc2eab03"
server_key_version: "encryptionkey@0"
I20260810 03:48:03.049225 6277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "25849052e18a477cbd377b52cb5e8747"
format_stamp: "Formatted at 2026-08-10 03:48:03 on dist-test-slave-qg60"
server_key: "6638cb0441efc11ef8e3f1df24ac9a85"
server_key_iv: "5989fccf84d9f90ab7cab1bacc2eab03"
server_key_version: "encryptionkey@0"
I20260810 03:48:03.053968 6277 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:48:03.056941 6292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:03.058324 6277 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:03.058485 6277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "25849052e18a477cbd377b52cb5e8747"
format_stamp: "Formatted at 2026-08-10 03:48:03 on dist-test-slave-qg60"
server_key: "6638cb0441efc11ef8e3f1df24ac9a85"
server_key_iv: "5989fccf84d9f90ab7cab1bacc2eab03"
server_key_version: "encryptionkey@0"
I20260810 03:48:03.058663 6277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:03.079689 6277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:03.084564 6277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:03.084842 6277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:03.085496 6277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:03.086431 6277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:03.086504 6277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:03.086577 6277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:03.086627 6277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:03.096856 6277 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:37277
I20260810 03:48:03.096877 6419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:37277 every 8 connection(s)
I20260810 03:48:03.097980 6277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:48:03.101027 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 6277
I20260810 03:48:03.101178 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:48:03.101538 23067 external_mini_cluster.cc:1428] Setting key 4c12e12e6bc5eb34d2c9dbf50e86b0af
Aug 10 03:48:03 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:03.113673 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.100113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:40267 (local address 127.22.134.254:32969)
0810 03:48:03.100298 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.100302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.101395 (+ 1093us) server_negotiation.cc:407] Connection header received
0810 03:48:03.103044 (+ 1649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.103048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.103106 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.103178 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:03.104534 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.105162 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.106448 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.106680 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.106772 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.109712 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:03.109715 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:03.109717 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:03.109746 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:03.111369 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:03.111970 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:03.111974 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:03.111975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:03.112066 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:03.112441 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:03.112445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:03.112447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:03.112661 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:03.112804 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.113349 (+ 545us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.113485 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 03:48:03.114754 6422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.100564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:40267)
0810 03:48:03.101195 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.101254 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:03.102805 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:03.103369 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:03.103379 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:03.103891 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:03.104393 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.104406 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.105289 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.105293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.106323 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.106333 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.106841 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.106845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.107006 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.107686 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:03.107704 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:03.109484 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:03.111510 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:03.111517 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:03.111538 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:03.111854 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:03.112173 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:03.112176 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:03.112178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:03.112341 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:03.112798 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:03.112806 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:03.113075 (+ 269us) client_negotiation.cc:769] Sending connection context
0810 03:48:03.113308 (+ 233us) client_negotiation.cc:240] Negotiation successful
0810 03:48:03.113678 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":252,"threads_started":1}
I20260810 03:48:03.116055 6420 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32969
I20260810 03:48:03.116304 6420 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:03.116889 6420 heartbeater.cc:511] Master 127.22.134.254:32969 requested a full tablet report, sending...
I20260810 03:48:03.118084 5900 ts_manager.cc:194] Registered new tserver with Master: 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277)
I20260810 03:48:03.118777 5900 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:40267
I20260810 03:48:03.128484 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:48:03.139878 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.130958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.22.134.254:32969)
0810 03:48:03.131145 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.131149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.131367 (+ 218us) server_negotiation.cc:407] Connection header received
0810 03:48:03.131461 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.131463 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.131517 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.131602 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:03.132475 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.133106 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.134170 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.134413 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.134515 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.136104 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:03.136107 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:03.136110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:03.136137 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:03.137891 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:03.138436 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:03.138439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:03.138441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:03.138530 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:03.138864 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:03.138866 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:03.138867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:03.139198 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:03.139311 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.139609 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.139744 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260810 03:48:03.143911 5900 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:48:03.147420 5900 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:48:03.163966 6434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.157605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49028 (local address 127.22.134.193:37913)
0810 03:48:03.159216 (+ 1611us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.159221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.159241 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:48:03.159304 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.159308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.159450 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.159853 (+ 403us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:03.160002 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.160865 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.162363 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.163163 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.163326 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.163476 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.163690 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.163805 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1496,"thread_start_us":105,"threads_started":1}
I20260810 03:48:03.163965 6433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.157442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:37913 (local address 127.0.0.1:49028)
0810 03:48:03.158315 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.158380 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:03.158517 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:03.159617 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:03.159624 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:03.159650 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:03.159906 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.159916 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.161010 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.161016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.162234 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.162244 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.163350 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.163356 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.163482 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.163518 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:48:03.163630 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 03:48:03.163744 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"mutex_wait_us":81,"spinlock_wait_cycles":3584,"thread_start_us":94,"threads_started":1}
I20260810 03:48:03.164546 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.157688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:39885 (local address 127.0.0.1:43428)
0810 03:48:03.158790 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.158804 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:03.158924 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:03.159651 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:03.159655 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:03.159676 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:03.159866 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.159872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.161409 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.161411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.162936 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.162948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.164078 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.164083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.164181 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.164208 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 03:48:03.164277 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 03:48:03.164362 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1035,"mutex_wait_us":181,"thread_start_us":135,"threads_started":1}
I20260810 03:48:03.164567 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.158062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43428 (local address 127.22.134.194:39885)
0810 03:48:03.158515 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.158532 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.158923 (+ 391us) server_negotiation.cc:407] Connection header received
0810 03:48:03.159103 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.159110 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.159355 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.159501 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:03.160011 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.161222 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.163090 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.163936 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.164083 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.164244 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.164301 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.164397 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":127,"threads_started":1}
I20260810 03:48:03.166868 6437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.158290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:37277 (local address 127.0.0.1:47514)
0810 03:48:03.158840 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.158851 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:03.158965 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:03.159710 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:03.159712 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:03.159725 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:03.159850 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.159859 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.161404 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.161407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.162936 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.162948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.166424 (+ 3476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.166428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.166523 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.166547 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:48:03.166642 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 03:48:03.166729 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":127,"thread_start_us":111,"threads_started":1}
I20260810 03:48:03.166900 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.158774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47514 (local address 127.22.134.195:37277)
0810 03:48:03.159129 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.159141 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.159164 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:48:03.159242 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.159247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.159434 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.159589 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:03.159996 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.161237 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.164841 (+ 3604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.166272 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.166427 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.166554 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.166673 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.166768 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
I20260810 03:48:03.168295 6197 tablet_service.cc:1467] Processing CreateTablet for tablet 7bad95a4388344f2844a0dcdb86a58d9 (DEFAULT_TABLE table=test-table [id=94b4019fa4bd4b958193022264aff0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:03.168292 6051 tablet_service.cc:1467] Processing CreateTablet for tablet 7bad95a4388344f2844a0dcdb86a58d9 (DEFAULT_TABLE table=test-table [id=94b4019fa4bd4b958193022264aff0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:03.169710 6197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bad95a4388344f2844a0dcdb86a58d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:03.169710 6051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bad95a4388344f2844a0dcdb86a58d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:03.171664 6345 tablet_service.cc:1467] Processing CreateTablet for tablet 7bad95a4388344f2844a0dcdb86a58d9 (DEFAULT_TABLE table=test-table [id=94b4019fa4bd4b958193022264aff0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:03.172806 6345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bad95a4388344f2844a0dcdb86a58d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:03.178100 6439 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Bootstrap starting.
I20260810 03:48:03.178604 6440 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: Bootstrap starting.
I20260810 03:48:03.179694 6441 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: Bootstrap starting.
I20260810 03:48:03.181998 6441 tablet_bootstrap.cc:654] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:03.182000 6439 tablet_bootstrap.cc:654] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:03.182972 6439 log.cc:824] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:03.183166 6441 log.cc:824] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:03.184070 6440 tablet_bootstrap.cc:654] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:03.184859 6440 log.cc:824] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:03.185453 6441 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: No bootstrap required, opened a new log
I20260810 03:48:03.185453 6439 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: No bootstrap required, opened a new log
I20260810 03:48:03.185670 6441 ts_tablet_manager.cc:1397] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:48:03.185671 6439 ts_tablet_manager.cc:1397] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.004s
I20260810 03:48:03.187040 6440 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: No bootstrap required, opened a new log
I20260810 03:48:03.187305 6440 ts_tablet_manager.cc:1397] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260810 03:48:03.190866 6440 raft_consensus.cc:348] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.190831 6441 raft_consensus.cc:348] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.190958 6439 raft_consensus.cc:348] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.191149 6440 raft_consensus.cc:374] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:03.191149 6441 raft_consensus.cc:374] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:03.191198 6439 raft_consensus.cc:374] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:03.191206 6441 raft_consensus.cc:729] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25849052e18a477cbd377b52cb5e8747, State: Initialized, Role: FOLLOWER
I20260810 03:48:03.191217 6440 raft_consensus.cc:729] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94d6f0e764d461dac8d095737fd8e0a, State: Initialized, Role: FOLLOWER
I20260810 03:48:03.191258 6439 raft_consensus.cc:729] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72cf8d9fad448c1b991ec6fda139e8b, State: Initialized, Role: FOLLOWER
I20260810 03:48:03.191695 6440 consensus_queue.cc:260] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.191702 6439 consensus_queue.cc:260] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.191705 6441 consensus_queue.cc:260] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.192698 6121 heartbeater.cc:503] Master 127.22.134.254:32969 was elected leader, sending a full tablet report...
I20260810 03:48:03.192853 6441 ts_tablet_manager.cc:1428] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260810 03:48:03.193018 6420 heartbeater.cc:503] Master 127.22.134.254:32969 was elected leader, sending a full tablet report...
I20260810 03:48:03.193056 6269 heartbeater.cc:503] Master 127.22.134.254:32969 was elected leader, sending a full tablet report...
I20260810 03:48:03.192858 6440 ts_tablet_manager.cc:1428] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260810 03:48:03.193986 6439 ts_tablet_manager.cc:1428] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260810 03:48:03.283317 6448 raft_consensus.cc:482] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:03.283681 6448 raft_consensus.cc:504] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.285434 6448 leader_election.cc:288] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913), c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885)
I20260810 03:48:03.289508 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.286002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:48177 (local address 127.22.134.194:39885)
0810 03:48:03.286143 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.286146 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.286161 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:48:03.286212 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.286214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.286256 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.286364 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:03.286693 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.287208 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.288412 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.288897 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.289064 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.289137 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.289312 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.289381 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:48:03.289508 6422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.285777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:39885 (local address 127.22.134.195:48177)
0810 03:48:03.285911 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.285930 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:03.286057 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:03.286379 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:03.286382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:03.286400 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:03.286530 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.286536 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.287329 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.287335 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.288280 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.288290 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.289064 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.289067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.289181 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.289206 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:48:03.289294 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 03:48:03.289366 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 03:48:03.290421 6217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bad95a4388344f2844a0dcdb86a58d9" candidate_uuid: "25849052e18a477cbd377b52cb5e8747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94d6f0e764d461dac8d095737fd8e0a" is_pre_election: true
I20260810 03:48:03.290678 6434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.285876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35119 (local address 127.22.134.193:37913)
0810 03:48:03.286033 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.286038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.286683 (+ 645us) server_negotiation.cc:407] Connection header received
0810 03:48:03.286845 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.286851 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.286901 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.287134 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:03.287436 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.287980 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.289228 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.290001 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.290198 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.290251 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.290454 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.290550 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:48:03.290695 6449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.285777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:37913 (local address 127.22.134.195:35119)
0810 03:48:03.286578 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.286592 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:03.286722 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:03.287150 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:03.287153 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:03.287171 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:03.287306 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.287312 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.288112 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.288117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.289102 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.289112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.290198 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.290203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.290315 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.290340 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 03:48:03.290435 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 03:48:03.290540 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":739,"mutex_wait_us":363,"thread_start_us":164,"threads_started":1}
I20260810 03:48:03.290858 6217 raft_consensus.cc:2454] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25849052e18a477cbd377b52cb5e8747 in term 0.
I20260810 03:48:03.291385 6293 leader_election.cc:302] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a; no voters:
I20260810 03:48:03.291451 6073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bad95a4388344f2844a0dcdb86a58d9" candidate_uuid: "25849052e18a477cbd377b52cb5e8747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" is_pre_election: true
I20260810 03:48:03.291697 6448 raft_consensus.cc:2781] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:48:03.291818 6448 raft_consensus.cc:482] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:48:03.291813 6073 raft_consensus.cc:2454] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25849052e18a477cbd377b52cb5e8747 in term 0.
I20260810 03:48:03.291885 6448 raft_consensus.cc:3037] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:03.293179 6448 raft_consensus.cc:504] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.293587 6448 leader_election.cc:288] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [CANDIDATE]: Term 1 election: Requested vote from peers d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913), c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885)
I20260810 03:48:03.293994 6217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bad95a4388344f2844a0dcdb86a58d9" candidate_uuid: "25849052e18a477cbd377b52cb5e8747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94d6f0e764d461dac8d095737fd8e0a"
I20260810 03:48:03.293980 6073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bad95a4388344f2844a0dcdb86a58d9" candidate_uuid: "25849052e18a477cbd377b52cb5e8747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72cf8d9fad448c1b991ec6fda139e8b"
I20260810 03:48:03.294124 6217 raft_consensus.cc:3037] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:03.294124 6073 raft_consensus.cc:3037] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:03.295544 6073 raft_consensus.cc:2454] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25849052e18a477cbd377b52cb5e8747 in term 1.
I20260810 03:48:03.295544 6217 raft_consensus.cc:2454] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25849052e18a477cbd377b52cb5e8747 in term 1.
I20260810 03:48:03.295881 6293 leader_election.cc:302] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a; no voters:
I20260810 03:48:03.296068 6448 raft_consensus.cc:2781] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:48:03.296344 6448 raft_consensus.cc:686] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 1 LEADER]: Becoming Leader. State: Replica: 25849052e18a477cbd377b52cb5e8747, State: Running, Role: LEADER
I20260810 03:48:03.296707 6448 consensus_queue.cc:237] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.300462 5901 catalog_manager.cc:5495] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25849052e18a477cbd377b52cb5e8747 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "25849052e18a477cbd377b52cb5e8747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } health_report { overall_health: HEALTHY } } }
I20260810 03:48:03.319193 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.315184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35474 (local address 127.22.134.195:37277)
0810 03:48:03.315317 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.315321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.315335 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:48:03.315471 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.315473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.315527 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.315631 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:48:03.315863 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.316422 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.317376 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.317651 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.317755 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.318022 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:48:03.318563 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:48:03.318682 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.318958 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.319010 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:48:03.325946 6217 raft_consensus.cc:1261] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 1 FOLLOWER]: Refusing update from remote peer 25849052e18a477cbd377b52cb5e8747: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:48:03.325970 6073 raft_consensus.cc:1261] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Refusing update from remote peer 25849052e18a477cbd377b52cb5e8747: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:48:03.326882 6450 consensus_queue.cc:1035] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:48:03.327149 6448 consensus_queue.cc:1035] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:48:03.335686 6453 mvcc.cc:205] Tried to move back new op lower bound from 7316822766893871104 to 7316822766786576384. Current Snapshot: MvccSnapshot[applied={T|T < 7316822766893871104}]
I20260810 03:48:03.338979 6455 mvcc.cc:205] Tried to move back new op lower bound from 7316822766893871104 to 7316822766786576384. Current Snapshot: MvccSnapshot[applied={T|T < 7316822766893871104}]
I20260810 03:48:03.345278 5900 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:48:03.345491 5900 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:48:03.348186 5900 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Sending DeleteTablet for 3 replicas of tablet 7bad95a4388344f2844a0dcdb86a58d9
I20260810 03:48:03.349237 6345 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bad95a4388344f2844a0dcdb86a58d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:03 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:47514
I20260810 03:48:03.349249 6197 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bad95a4388344f2844a0dcdb86a58d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:03 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:43428
I20260810 03:48:03.349833 6465 tablet_replica.cc:330] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: stopping tablet replica
I20260810 03:48:03.349822 6051 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bad95a4388344f2844a0dcdb86a58d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:03 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:49028
I20260810 03:48:03.350165 6465 raft_consensus.cc:2229] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:48:03.350512 6465 raft_consensus.cc:2258] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:03.350526 6464 tablet_replica.cc:330] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: stopping tablet replica
I20260810 03:48:03.350539 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 5968
I20260810 03:48:03.350821 6464 raft_consensus.cc:2229] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:48:03.351212 6464 raft_consensus.cc:2258] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:03.353334 6465 ts_tablet_manager.cc:1905] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:03.356508 6465 ts_tablet_manager.cc:1918] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:03.356644 6465 log.cc:1196] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/7bad95a4388344f2844a0dcdb86a58d9
I20260810 03:48:03.357061 6465 ts_tablet_manager.cc:1939] T 7bad95a4388344f2844a0dcdb86a58d9 P c94d6f0e764d461dac8d095737fd8e0a: Deleting consensus metadata
I20260810 03:48:03.358942 5888 catalog_manager.cc:4841] TS c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885): tablet 7bad95a4388344f2844a0dcdb86a58d9 (table test-table [id=94b4019fa4bd4b958193022264aff0b6]) successfully deleted
I20260810 03:48:03.359709 6464 ts_tablet_manager.cc:1905] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 03:48:03.361372 5891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:37913 (error 108)
I20260810 03:48:03.361764 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 6127
I20260810 03:48:03.362562 6464 ts_tablet_manager.cc:1918] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:03.362666 6464 log.cc:1196] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/7bad95a4388344f2844a0dcdb86a58d9
I20260810 03:48:03.362939 6464 ts_tablet_manager.cc:1939] T 7bad95a4388344f2844a0dcdb86a58d9 P 25849052e18a477cbd377b52cb5e8747: Deleting consensus metadata
I20260810 03:48:03.366345 6437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.365971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:37913 (local address 127.0.0.1:36144)
0810 03:48:03.366135 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.366227 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:37913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 03:48:03.366375 5889 catalog_manager.cc:4841] TS 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277): tablet 7bad95a4388344f2844a0dcdb86a58d9 (table test-table [id=94b4019fa4bd4b958193022264aff0b6]) successfully deleted
W20260810 03:48:03.366565 5891 catalog_manager.cc:4584] TS d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7bad95a4388344f2844a0dcdb86a58d9: Network error: Client connection negotiation failed: client connection to 127.22.134.193:37913: connect: Connection refused (error 111)
I20260810 03:48:03.371853 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 6277
I20260810 03:48:03.380383 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 5870
I20260810 03:48:03.390447 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:32969
--webserver_interface=127.22.134.254
--webserver_port=36557
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:32969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:03.507548 6469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:03.507835 6469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:03.507877 6469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:03.512112 6469 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:48:03.512197 6469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:03.512217 6469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:03.512235 6469 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:48:03.512251 6469 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:48:03.518070 6469 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:32969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:32969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=36557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:03.519271 6469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:03.520325 6469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:03.538121 6476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:03.538121 6479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:03.538364 6469 server_base.cc:1034] running on GCE node
W20260810 03:48:03.538123 6477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:03.539175 6469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:03.540489 6469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:03.541719 6469 hybrid_clock.cc:648] HybridClock initialized: now 1786333683541694 us; error 41 us; skew 500 ppm
Aug 10 03:48:03 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:03.545161 6469 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:48:03.546280 6469 webserver.cc:460] Webserver started at http://127.22.134.254:36557/ using document root <none> and password file <none>
I20260810 03:48:03.546928 6469 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:03.547022 6469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:03.551863 6469 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:48:03.554713 6487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:03.556298 6469 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:48:03.556489 6469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "6ee91d592dc546e8b18a6e363851bf17"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "909d5fd1184ee42255a355656f35a24a"
server_key_iv: "f6542ad9d9020e92cc098c8a2000f089"
server_key_version: "encryptionkey@0"
I20260810 03:48:03.557315 6469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:03.574499 6469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:03.578524 6469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:03.578765 6469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:03.586566 6469 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:32969
I20260810 03:48:03.586885 6547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:32969 every 8 connection(s)
I20260810 03:48:03.587809 6469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:48:03.588646 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 6469
I20260810 03:48:03.589111 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:37913
--local_ip_for_outbound_sockets=127.22.134.193
--tserver_master_addrs=127.22.134.254:32969
--webserver_port=42483
--webserver_interface=127.22.134.193
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:48:03.592994 6548 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:48:03.594926 6548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Bootstrap starting.
I20260810 03:48:03.613570 6548 log.cc:824] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:03.622956 6548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:48:03.623394 6548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Bootstrap complete.
I20260810 03:48:03.627766 6548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:03.628237 6548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee91d592dc546e8b18a6e363851bf17, State: Initialized, Role: FOLLOWER
I20260810 03:48:03.628860 6548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:03.629042 6548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:48:03.629149 6548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:48:03.629280 6548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:48:03.631583 6548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:03.631963 6548 leader_election.cc:302] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ee91d592dc546e8b18a6e363851bf17; no voters:
I20260810 03:48:03.632336 6548 leader_election.cc:288] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 03:48:03.632458 6552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:48:03.632664 6552 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 2 LEADER]: Becoming Leader. State: Replica: 6ee91d592dc546e8b18a6e363851bf17, State: Running, Role: LEADER
I20260810 03:48:03.633024 6552 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:03.633725 6548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:48:03.634057 6552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ee91d592dc546e8b18a6e363851bf17. Latest consensus state: current_term: 2 leader_uuid: "6ee91d592dc546e8b18a6e363851bf17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } } }
I20260810 03:48:03.634286 6552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:03.634684 6553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6ee91d592dc546e8b18a6e363851bf17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } } }
I20260810 03:48:03.634707 6556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:48:03.636065 6553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:03.640252 6556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:48:03.641155 6556 catalog_manager.cc:1259] Loaded cluster ID: 70378fb9d5b740a3bb3ec3e6ecad348c
I20260810 03:48:03.641232 6556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:48:03.642604 6556 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 03:48:03.647027 6556 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 03:48:03.653138 6556 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:48:03.654036 6556 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Loaded TSK: 0
I20260810 03:48:03.655362 6556 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:48:03.715337 6550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:03.715628 6550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:03.715713 6550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:03.720029 6550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:03.720116 6550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:03.720180 6550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:48:03.726109 6550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:37913
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=42483
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:03.727213 6550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:03.728281 6550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:03.740425 6577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:03.740592 6580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:03.740419 6575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:03.741036 6550 server_base.cc:1034] running on GCE node
I20260810 03:48:03.741478 6550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:03.742244 6550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:03.743443 6550 hybrid_clock.cc:648] HybridClock initialized: now 1786333683743426 us; error 36 us; skew 500 ppm
Aug 10 03:48:03 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:03.746797 6550 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:48:03.748018 6550 webserver.cc:460] Webserver started at http://127.22.134.193:42483/ using document root <none> and password file <none>
I20260810 03:48:03.748835 6550 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:03.749001 6550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:03.754696 6550 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:48:03.757891 6587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:03.759593 6550 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:48:03.759732 6550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "d72cf8d9fad448c1b991ec6fda139e8b"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "8d337ce3c208c66bdfa93c02ce9a88e1"
server_key_iv: "ae310221123d00edcc18952a7a64ff0c"
server_key_version: "encryptionkey@0"
I20260810 03:48:03.760520 6550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:03.791929 6550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:03.796036 6550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:03.796247 6550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:03.797067 6550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:03.798552 6597 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 03:48:03.803184 6550 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 03:48:03.803260 6550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260810 03:48:03.803319 6550 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 03:48:03.805099 6550 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 03:48:03.805147 6550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260810 03:48:03.805461 6597 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Bootstrap starting.
I20260810 03:48:03.816470 6550 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:37913
I20260810 03:48:03.816560 6720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:37913 every 8 connection(s)
I20260810 03:48:03.817590 6550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:48:03.817816 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 6550
I20260810 03:48:03.818382 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:39885
--local_ip_for_outbound_sockets=127.22.134.194
--tserver_master_addrs=127.22.134.254:32969
--webserver_port=41517
--webserver_interface=127.22.134.194
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:48:03.825098 6597 log.cc:824] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:48:03 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:03.835980 6597 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:48:03.836660 6597 tablet_bootstrap.cc:492] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Bootstrap complete.
I20260810 03:48:03.837096 6727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.820927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:36307 (local address 127.22.134.254:32969)
0810 03:48:03.821437 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.821458 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.821635 (+ 177us) server_negotiation.cc:407] Connection header received
0810 03:48:03.822819 (+ 1184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.822830 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.823140 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.823480 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:03.824725 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.826136 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.827381 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.827869 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.828048 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.831376 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:03.831382 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:03.831395 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:03.831426 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:03.833328 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:03.833962 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:03.833975 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:03.833979 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:03.834112 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:03.834582 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:03.834589 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:03.834591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:03.835036 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:03.835184 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.835858 (+ 674us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.836134 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":149,"threads_started":1}
I20260810 03:48:03.837111 6726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.820311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:36307)
0810 03:48:03.821418 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.821482 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:03.822368 (+ 886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:03.823531 (+ 1163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:03.823539 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:03.823997 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:03.824467 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.824482 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.826308 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.826316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.827198 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.827208 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.828034 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.828038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.828249 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.829000 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:03.829025 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:03.831149 (+ 2124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:03.833476 (+ 2327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:03.833482 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:03.833495 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:03.833838 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:03.834271 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:03.834274 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:03.834276 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:03.834466 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:03.835156 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:03.835162 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:03.835528 (+ 366us) client_negotiation.cc:769] Sending connection context
0810 03:48:03.835727 (+ 199us) client_negotiation.cc:240] Negotiation successful
0810 03:48:03.836134 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"thread_start_us":161,"threads_started":1}
I20260810 03:48:03.838196 6597 ts_tablet_manager.cc:1397] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.008s
I20260810 03:48:03.839437 6721 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32969
I20260810 03:48:03.839696 6721 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:03.840204 6721 heartbeater.cc:511] Master 127.22.134.254:32969 requested a full tablet report, sending...
I20260810 03:48:03.841267 6597 raft_consensus.cc:348] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.841811 6597 raft_consensus.cc:729] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72cf8d9fad448c1b991ec6fda139e8b, State: Initialized, Role: FOLLOWER
I20260810 03:48:03.842322 6597 consensus_queue.cc:260] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } } peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } }
I20260810 03:48:03.842901 6507 ts_manager.cc:194] Registered new tserver with Master: d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913)
I20260810 03:48:03.843384 6597 ts_tablet_manager.cc:1428] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 03:48:03.846874 6507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:36307
I20260810 03:48:03.849705 6721 heartbeater.cc:503] Master 127.22.134.254:32969 was elected leader, sending a full tablet report...
Aug 10 03:48:03 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:48:03.858605 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.845961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:37913 (local address 127.0.0.1:36146)
0810 03:48:03.846399 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:03.846469 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:03.846632 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:03.848352 (+ 1720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:03.848359 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:03.848853 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:03.849034 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.849044 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.850290 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.850295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.851344 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:03.851356 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.851985 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.851989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:03.852114 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.852788 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:03.852803 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:03.854397 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:03.856570 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:03.856581 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:03.856587 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:03.856922 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:03.857264 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:03.857267 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:03.857269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:03.857362 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:03.857853 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:03.857860 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:03.858005 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 03:48:03.858170 (+ 165us) client_negotiation.cc:240] Negotiation successful
0810 03:48:03.858415 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":111,"threads_started":1}
I20260810 03:48:03.858604 6731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:03.846042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36146 (local address 127.22.134.193:37913)
0810 03:48:03.847818 (+ 1776us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:03.847833 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:03.847865 (+ 32us) server_negotiation.cc:407] Connection header received
0810 03:48:03.847943 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:03.847948 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:03.848166 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:03.848324 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:03.849181 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.850158 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.851457 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:03.851835 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:03.851953 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:03.854573 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:03.854582 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:03.854593 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:03.854623 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:03.856435 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:03.857059 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:03.857072 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:03.857074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:03.857157 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:03.857464 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:03.857467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:03.857469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:03.857732 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:03.857877 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:03.858268 (+ 391us) server_negotiation.cc:299] Negotiation successful
0810 03:48:03.858421 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1622,"thread_start_us":103,"threads_started":1}
I20260810 03:48:03.859748 6647 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bad95a4388344f2844a0dcdb86a58d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:03 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:36146
I20260810 03:48:03.860718 6732 tablet_replica.cc:330] stopping tablet replica
I20260810 03:48:03.861104 6732 raft_consensus.cc:2229] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:48:03.861385 6732 raft_consensus.cc:2258] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:03.862663 6732 ts_tablet_manager.cc:1905] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:03.867612 6732 ts_tablet_manager.cc:1918] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:03.867753 6732 log.cc:1196] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/7bad95a4388344f2844a0dcdb86a58d9
I20260810 03:48:03.868055 6732 ts_tablet_manager.cc:1939] T 7bad95a4388344f2844a0dcdb86a58d9 P d72cf8d9fad448c1b991ec6fda139e8b: Deleting consensus metadata
I20260810 03:48:03.870041 6491 catalog_manager.cc:4841] TS d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913): tablet 7bad95a4388344f2844a0dcdb86a58d9 (table test-table [id=94b4019fa4bd4b958193022264aff0b6]) successfully deleted
W20260810 03:48:03.951925 6725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:03.952222 6725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:03.952287 6725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:03.956676 6725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:03.956813 6725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:03.956923 6725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:48:03.962662 6725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:39885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=41517
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:03.963858 6725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:03.964998 6725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:03.975339 6738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:03.975414 6741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:03.975373 6739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:03.975723 6725 server_base.cc:1034] running on GCE node
I20260810 03:48:03.976291 6725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:03.976994 6725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:03.978196 6725 hybrid_clock.cc:648] HybridClock initialized: now 1786333683978173 us; error 34 us; skew 500 ppm
Aug 10 03:48:03 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:03.981244 6725 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:48:03.982242 6725 webserver.cc:460] Webserver started at http://127.22.134.194:41517/ using document root <none> and password file <none>
I20260810 03:48:03.982800 6725 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:03.982877 6725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:03.987079 6725 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:48:03.989444 6748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:03.990947 6725 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:03.991134 6725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "c94d6f0e764d461dac8d095737fd8e0a"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "b54ec556968f81e7c4c83bcbc634c1a5"
server_key_iv: "48d89e682fc3fafe79f1dbbca163cadc"
server_key_version: "encryptionkey@0"
I20260810 03:48:03.991704 6725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:04.004062 6725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:04.007807 6725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:04.007999 6725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:04.008599 6725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:04.009584 6725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:04.009635 6725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:04.009706 6725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:04.009740 6725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:04.019937 6725 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:39885
I20260810 03:48:04.019959 6881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:39885 every 8 connection(s)
I20260810 03:48:04.021136 6725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:48:04.021471 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 6725
I20260810 03:48:04.021998 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:37277
--local_ip_for_outbound_sockets=127.22.134.195
--tserver_master_addrs=127.22.134.254:32969
--webserver_port=42793
--webserver_interface=127.22.134.195
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:48:04 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:04.040664 6727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.023371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:50611 (local address 127.22.134.254:32969)
0810 03:48:04.023544 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.023549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.024566 (+ 1017us) server_negotiation.cc:407] Connection header received
0810 03:48:04.026761 (+ 2195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.026765 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.026824 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.026908 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:04.028836 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.029402 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.031505 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.031753 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.031845 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.036024 (+ 4179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:04.036028 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:04.036030 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:04.036064 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:04.038036 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:04.038715 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:04.038722 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:04.038724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:04.038827 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:04.039329 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:04.039332 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:04.039334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:04.039594 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:04.039696 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.040305 (+ 609us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.040469 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 03:48:04.041781 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.023794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:50611)
0810 03:48:04.024349 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.024415 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:04.026450 (+ 2035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:04.027174 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:04.027187 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:04.027788 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:04.028594 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.028620 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.029644 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.029650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.031340 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.031356 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.031945 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.031951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.032209 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.033098 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:04.033128 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:04.035599 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:04.038229 (+ 2630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:04.038235 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:04.038251 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:04.038573 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:04.038960 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:04.038963 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:04.038965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:04.039214 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:04.039739 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:04.039745 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:04.040031 (+ 286us) client_negotiation.cc:769] Sending connection context
0810 03:48:04.040222 (+ 191us) client_negotiation.cc:240] Negotiation successful
0810 03:48:04.040530 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":115,"threads_started":1}
I20260810 03:48:04.043418 6882 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32969
I20260810 03:48:04.043757 6882 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:04.044355 6882 heartbeater.cc:511] Master 127.22.134.254:32969 requested a full tablet report, sending...
I20260810 03:48:04.045758 6507 ts_manager.cc:194] Registered new tserver with Master: c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885)
I20260810 03:48:04.046428 6507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:50611
W20260810 03:48:04.145454 6884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:04.145761 6884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:04.145839 6884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:04.150117 6884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:04.150215 6884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:04.150315 6884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:48:04.156153 6884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:37277
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=42793
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:04.157372 6884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:04.158463 6884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:04.169168 6894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:04.169180 6892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:04.169234 6896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:04.169505 6884 server_base.cc:1034] running on GCE node
I20260810 03:48:04.170003 6884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:04.170728 6884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:04.171921 6884 hybrid_clock.cc:648] HybridClock initialized: now 1786333684171877 us; error 56 us; skew 500 ppm
Aug 10 03:48:04 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333684, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:04.175588 6884 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:48:04.176797 6884 webserver.cc:460] Webserver started at http://127.22.134.195:42793/ using document root <none> and password file <none>
I20260810 03:48:04.177434 6884 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:04.177563 6884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:04.182050 6884 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260810 03:48:04.184542 6905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:04.185994 6884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:48:04.186158 6884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "25849052e18a477cbd377b52cb5e8747"
format_stamp: "Formatted at 2026-08-10 03:48:03 on dist-test-slave-qg60"
server_key: "6638cb0441efc11ef8e3f1df24ac9a85"
server_key_iv: "5989fccf84d9f90ab7cab1bacc2eab03"
server_key_version: "encryptionkey@0"
I20260810 03:48:04.186796 6884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:04.203321 6884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:04.206950 6884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:04.207190 6884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:04.207865 6884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:04.208863 6884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:04.208945 6884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:04.209038 6884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:04.209090 6884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:04.219182 6884 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:37277
I20260810 03:48:04.219198 7040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:37277 every 8 connection(s)
I20260810 03:48:04.220244 6884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:48:04.220956 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 6884
I20260810 03:48:04.231935 6727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.221798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57880 (local address 127.22.134.254:32969)
0810 03:48:04.221945 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.221950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.222172 (+ 222us) server_negotiation.cc:407] Connection header received
0810 03:48:04.222284 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.222290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.222353 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.222436 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:04.223520 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.224290 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.225379 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.225720 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.225825 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.227887 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:04.227890 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:04.227892 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:04.227920 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:04.229655 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:04.230373 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:04.230376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:04.230377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:04.230468 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:04.230851 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:04.230854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:04.230856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:04.231172 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:04.231417 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.231597 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.231737 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 03:48:04 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333684, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:04.238067 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.222464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:36533 (local address 127.22.134.254:32969)
0810 03:48:04.222714 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.222717 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.223916 (+ 1199us) server_negotiation.cc:407] Connection header received
0810 03:48:04.225590 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.225592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.225642 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.225718 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:04.227198 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.228014 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.229958 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.230425 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.230518 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.233800 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:04.233804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:04.233807 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:04.233835 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:04.235552 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:04.236214 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:04.236217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:04.236218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:04.236299 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:04.236808 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:04.236811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:04.236813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:04.237039 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:04.237171 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.237738 (+ 567us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.237879 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":110,"threads_started":1}
I20260810 03:48:04.238965 7045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.223097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:36533)
0810 03:48:04.223740 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.223801 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:04.225347 (+ 1546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:04.225917 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:04.225928 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:04.226442 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:04.227023 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.227039 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.228155 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.228161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.229810 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.229822 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.230641 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.230646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.230844 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.231587 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:04.231606 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:04.233595 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:04.235681 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:04.235687 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:04.235702 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:04.236076 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:04.236418 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:04.236420 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:04.236422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:04.236584 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:04.237169 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:04.237177 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:04.237466 (+ 289us) client_negotiation.cc:769] Sending connection context
0810 03:48:04.237681 (+ 215us) client_negotiation.cc:240] Negotiation successful
0810 03:48:04.238062 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":168,"threads_started":1}
I20260810 03:48:04.240190 7041 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32969
I20260810 03:48:04.240461 7041 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:04.241065 7041 heartbeater.cc:511] Master 127.22.134.254:32969 requested a full tablet report, sending...
I20260810 03:48:04.242239 6507 ts_manager.cc:194] Registered new tserver with Master: 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277)
I20260810 03:48:04.242820 6507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:36533
I20260810 03:48:04.246102 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:48:04.250880 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.246804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57892 (local address 127.22.134.254:32969)
0810 03:48:04.246964 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.246969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.247213 (+ 244us) server_negotiation.cc:407] Connection header received
0810 03:48:04.247417 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.247419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.247515 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.247656 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:48:04.247914 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.248427 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.249400 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.249636 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.249756 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.250080 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:48:04.250469 (+ 389us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:48:04.250606 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.250674 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.250736 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:48:04.251592 6507 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:57892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:48:04.255448 6507 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:48:04.264622 6647 tablet_service.cc:1467] Processing CreateTablet for tablet b4f3bfbbbffd4dda8c4e11a231c335d2 (DEFAULT_TABLE table=test-table [id=1f51c5a764f74833b348326c221fcebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:04.265388 6647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4f3bfbbbffd4dda8c4e11a231c335d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:04.268473 6597 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Bootstrap starting.
I20260810 03:48:04.269495 6597 tablet_bootstrap.cc:654] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:04.269605 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.263488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:39885 (local address 127.0.0.1:39036)
0810 03:48:04.263632 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.263651 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:04.263743 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:04.264821 (+ 1078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:04.264825 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:04.264847 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:04.264964 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.264970 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.266510 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.266516 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.267712 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.267723 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.269112 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.269115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.269224 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.269282 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 03:48:04.269340 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 03:48:04.269443 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 03:48:04.269989 7053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.263945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:37277 (local address 127.0.0.1:35488)
0810 03:48:04.264244 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.264258 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:04.264352 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:04.265435 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:04.265438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:04.265455 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:04.265545 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.265552 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.267060 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.267064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.268072 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.268081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.269461 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.269464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.269698 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.269735 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:48:04.269806 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 03:48:04.269887 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":128,"threads_started":1}
I20260810 03:48:04.270349 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.263661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39036 (local address 127.22.134.194:39885)
0810 03:48:04.264221 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.264234 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.264260 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:48:04.264347 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.264355 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.264626 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.264850 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:04.265212 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.266370 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.267851 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.268942 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.269834 (+ 892us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.269998 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.270057 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.270184 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":185,"threads_started":1}
I20260810 03:48:04.270480 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.264268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35488 (local address 127.22.134.195:37277)
0810 03:48:04.264706 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.264719 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.264769 (+ 50us) server_negotiation.cc:407] Connection header received
0810 03:48:04.264845 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.264850 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.265121 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.265279 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:04.265678 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.266927 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.268191 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.269326 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.269462 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.269600 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.270196 (+ 596us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.270299 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":116,"threads_started":1}
I20260810 03:48:04.272217 6597 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: No bootstrap required, opened a new log
I20260810 03:48:04.272321 6597 ts_tablet_manager.cc:1397] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 03:48:04.272866 6597 raft_consensus.cc:348] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.273012 6597 raft_consensus.cc:374] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:04.273062 6597 raft_consensus.cc:729] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72cf8d9fad448c1b991ec6fda139e8b, State: Initialized, Role: FOLLOWER
I20260810 03:48:04.273200 6597 consensus_queue.cc:260] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.273499 6597 ts_tablet_manager.cc:1428] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 03:48:04.273689 6808 tablet_service.cc:1467] Processing CreateTablet for tablet b4f3bfbbbffd4dda8c4e11a231c335d2 (DEFAULT_TABLE table=test-table [id=1f51c5a764f74833b348326c221fcebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:04.274925 6808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4f3bfbbbffd4dda8c4e11a231c335d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:04.274888 6965 tablet_service.cc:1467] Processing CreateTablet for tablet b4f3bfbbbffd4dda8c4e11a231c335d2 (DEFAULT_TABLE table=test-table [id=1f51c5a764f74833b348326c221fcebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:04.275918 6965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4f3bfbbbffd4dda8c4e11a231c335d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:04.283900 7056 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: Bootstrap starting.
I20260810 03:48:04.283900 7057 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: Bootstrap starting.
I20260810 03:48:04.286999 7056 tablet_bootstrap.cc:654] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:04.286999 7057 tablet_bootstrap.cc:654] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:04.287968 7057 log.cc:824] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:04.287968 7056 log.cc:824] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:04.289999 7056 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: No bootstrap required, opened a new log
I20260810 03:48:04.290009 7057 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: No bootstrap required, opened a new log
I20260810 03:48:04.290215 7056 ts_tablet_manager.cc:1397] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 03:48:04.290210 7057 ts_tablet_manager.cc:1397] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 03:48:04.293242 7056 raft_consensus.cc:348] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.293290 7057 raft_consensus.cc:348] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.293480 7057 raft_consensus.cc:374] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:04.293506 7056 raft_consensus.cc:374] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:04.293550 7057 raft_consensus.cc:729] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25849052e18a477cbd377b52cb5e8747, State: Initialized, Role: FOLLOWER
I20260810 03:48:04.293574 7056 raft_consensus.cc:729] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94d6f0e764d461dac8d095737fd8e0a, State: Initialized, Role: FOLLOWER
I20260810 03:48:04.294029 7057 consensus_queue.cc:260] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.294051 7056 consensus_queue.cc:260] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.294924 7041 heartbeater.cc:503] Master 127.22.134.254:32969 was elected leader, sending a full tablet report...
I20260810 03:48:04.294950 6882 heartbeater.cc:503] Master 127.22.134.254:32969 was elected leader, sending a full tablet report...
I20260810 03:48:04.295161 7056 ts_tablet_manager.cc:1428] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 03:48:04.295177 7057 ts_tablet_manager.cc:1428] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 03:48:04.312319 7061 raft_consensus.cc:482] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:04.312566 7061 raft_consensus.cc:504] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.313997 7061 leader_election.cc:288] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885), d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913)
I20260810 03:48:04.317763 7045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.314229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:39885 (local address 127.22.134.195:34037)
0810 03:48:04.314437 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.314453 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:04.314552 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:04.314819 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:04.314822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:04.314863 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:04.314976 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.314981 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.315739 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.315744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.316569 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.316577 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.317321 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.317325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.317435 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.317454 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 03:48:04.317544 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 03:48:04.317627 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"spinlock_wait_cycles":3200}
I20260810 03:48:04.317763 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.314308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:34037 (local address 127.22.134.194:39885)
0810 03:48:04.314432 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.314436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.314525 (+ 89us) server_negotiation.cc:407] Connection header received
0810 03:48:04.314661 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.314670 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.314714 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.314797 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:04.315120 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.315629 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.316711 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.317194 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.317327 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.317384 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.317561 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.317634 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 03:48:04.318116 6731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.314431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:45839 (local address 127.22.134.193:37913)
0810 03:48:04.314562 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.314567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.314814 (+ 247us) server_negotiation.cc:407] Connection header received
0810 03:48:04.314983 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.314986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.315050 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.315161 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:04.315434 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.315958 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.317087 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.317591 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.317728 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.317891 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.317932 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.318002 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 03:48:04.318140 7063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.314278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:37913 (local address 127.22.134.195:45839)
0810 03:48:04.314716 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.314727 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:04.314873 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:04.315181 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:04.315184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:04.315200 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:04.315319 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.315325 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.316111 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.316114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.316957 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:04.316973 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.317722 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.317726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:04.317829 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.317849 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 03:48:04.317915 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 03:48:04.317990 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"spinlock_wait_cycles":22784,"thread_start_us":171,"threads_started":1}
I20260810 03:48:04.318658 6831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4f3bfbbbffd4dda8c4e11a231c335d2" candidate_uuid: "25849052e18a477cbd377b52cb5e8747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94d6f0e764d461dac8d095737fd8e0a" is_pre_election: true
I20260810 03:48:04.318666 6668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4f3bfbbbffd4dda8c4e11a231c335d2" candidate_uuid: "25849052e18a477cbd377b52cb5e8747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" is_pre_election: true
I20260810 03:48:04.318980 6668 raft_consensus.cc:2454] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25849052e18a477cbd377b52cb5e8747 in term 0.
I20260810 03:48:04.318981 6831 raft_consensus.cc:2454] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25849052e18a477cbd377b52cb5e8747 in term 0.
W20260810 03:48:04.319211 6723 tablet.cc:2369] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:48:04.319589 6909 leader_election.cc:302] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a, d72cf8d9fad448c1b991ec6fda139e8b; no voters:
I20260810 03:48:04.319972 7061 raft_consensus.cc:2781] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:48:04.320061 7061 raft_consensus.cc:482] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:48:04.320108 7061 raft_consensus.cc:3037] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:04.321171 7061 raft_consensus.cc:504] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.321568 7061 leader_election.cc:288] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [CANDIDATE]: Term 1 election: Requested vote from peers c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885), d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913)
I20260810 03:48:04.321946 6831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4f3bfbbbffd4dda8c4e11a231c335d2" candidate_uuid: "25849052e18a477cbd377b52cb5e8747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94d6f0e764d461dac8d095737fd8e0a"
I20260810 03:48:04.322009 6668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4f3bfbbbffd4dda8c4e11a231c335d2" candidate_uuid: "25849052e18a477cbd377b52cb5e8747" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72cf8d9fad448c1b991ec6fda139e8b"
I20260810 03:48:04.322098 6831 raft_consensus.cc:3037] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:04.322177 6668 raft_consensus.cc:3037] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:04.323216 6831 raft_consensus.cc:2454] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25849052e18a477cbd377b52cb5e8747 in term 1.
I20260810 03:48:04.323239 6668 raft_consensus.cc:2454] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25849052e18a477cbd377b52cb5e8747 in term 1.
I20260810 03:48:04.323546 6906 leader_election.cc:302] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a; no voters:
I20260810 03:48:04.323791 7061 raft_consensus.cc:2781] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:48:04.324021 7061 raft_consensus.cc:686] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 1 LEADER]: Becoming Leader. State: Replica: 25849052e18a477cbd377b52cb5e8747, State: Running, Role: LEADER
I20260810 03:48:04.324365 7061 consensus_queue.cc:237] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.327914 6507 catalog_manager.cc:5495] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25849052e18a477cbd377b52cb5e8747 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "25849052e18a477cbd377b52cb5e8747" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } health_report { overall_health: UNKNOWN } } }
I20260810 03:48:04.351009 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.347152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35492 (local address 127.22.134.195:37277)
0810 03:48:04.347333 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:04.347337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:04.347350 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:48:04.347424 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:04.347426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:04.347479 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:04.347568 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:48:04.347783 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.348282 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.349406 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:04.349621 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:04.349707 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:04.350016 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:48:04.350487 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:48:04.350585 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:04.350755 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 03:48:04.350810 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:48:04.357290 6831 raft_consensus.cc:1261] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 1 FOLLOWER]: Refusing update from remote peer 25849052e18a477cbd377b52cb5e8747: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:48:04.357306 6668 raft_consensus.cc:1261] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Refusing update from remote peer 25849052e18a477cbd377b52cb5e8747: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:48:04.358057 7064 consensus_queue.cc:1035] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:48:04.358263 7061 consensus_queue.cc:1035] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:48:04.365023 7067 mvcc.cc:205] Tried to move back new op lower bound from 7316822771119439872 to 7316822770995560448. Current Snapshot: MvccSnapshot[applied={T|T < 7316822771119439872}]
I20260810 03:48:04.366515 7069 mvcc.cc:205] Tried to move back new op lower bound from 7316822771119439872 to 7316822770995560448. Current Snapshot: MvccSnapshot[applied={T|T < 7316822771119439872}]
I20260810 03:48:04.366708 7068 mvcc.cc:205] Tried to move back new op lower bound from 7316822771119439872 to 7316822770995560448. Current Snapshot: MvccSnapshot[applied={T|T < 7316822771119439872}]
I20260810 03:48:04.375281 6505 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:57892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:48:04.375535 6505 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:57892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:48:04.378388 6505 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Sending DeleteTablet for 3 replicas of tablet b4f3bfbbbffd4dda8c4e11a231c335d2
I20260810 03:48:04.379421 6965 tablet_service.cc:1514] Processing DeleteTablet for tablet b4f3bfbbbffd4dda8c4e11a231c335d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:04 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:35488
I20260810 03:48:04.379410 6808 tablet_service.cc:1514] Processing DeleteTablet for tablet b4f3bfbbbffd4dda8c4e11a231c335d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:04 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:39036
I20260810 03:48:04.380017 7081 tablet_replica.cc:330] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: stopping tablet replica
I20260810 03:48:04.379987 6647 tablet_service.cc:1514] Processing DeleteTablet for tablet b4f3bfbbbffd4dda8c4e11a231c335d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:04 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:36146
I20260810 03:48:04.380380 7083 tablet_replica.cc:330] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: stopping tablet replica
I20260810 03:48:04.380406 7081 raft_consensus.cc:2229] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:48:04.380604 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 6550
I20260810 03:48:04.380594 7083 raft_consensus.cc:2229] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:48:04.380846 7081 raft_consensus.cc:2258] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:04.384204 7081 ts_tablet_manager.cc:1905] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:04.385891 7082 tablet_replica.cc:330] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: stopping tablet replica
I20260810 03:48:04.386322 7082 raft_consensus.cc:2229] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:48:04.386840 7082 raft_consensus.cc:2258] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:04.388283 7081 ts_tablet_manager.cc:1918] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:04.388408 7081 log.cc:1196] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/b4f3bfbbbffd4dda8c4e11a231c335d2
I20260810 03:48:04.388840 7081 ts_tablet_manager.cc:1939] T b4f3bfbbbffd4dda8c4e11a231c335d2 P c94d6f0e764d461dac8d095737fd8e0a: Deleting consensus metadata
I20260810 03:48:04.389338 7082 ts_tablet_manager.cc:1905] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:04.390350 6488 catalog_manager.cc:4841] TS c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885): tablet b4f3bfbbbffd4dda8c4e11a231c335d2 (table test-table [id=1f51c5a764f74833b348326c221fcebd]) successfully deleted
I20260810 03:48:04.392061 7082 ts_tablet_manager.cc:1918] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:04.392206 7082 log.cc:1196] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/b4f3bfbbbffd4dda8c4e11a231c335d2
I20260810 03:48:04.392590 7082 ts_tablet_manager.cc:1939] T b4f3bfbbbffd4dda8c4e11a231c335d2 P 25849052e18a477cbd377b52cb5e8747: Deleting consensus metadata
I20260810 03:48:04.393858 6489 catalog_manager.cc:4841] TS 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277): tablet b4f3bfbbbffd4dda8c4e11a231c335d2 (table test-table [id=1f51c5a764f74833b348326c221fcebd]) successfully deleted
I20260810 03:48:04.394681 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 6725
W20260810 03:48:04.394675 6491 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:37913 (error 108)
I20260810 03:48:04.398013 7053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.397702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:37913 (local address 127.0.0.1:36152)
0810 03:48:04.397844 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.397928 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:37913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 03:48:04.398281 6491 catalog_manager.cc:4584] TS d72cf8d9fad448c1b991ec6fda139e8b (127.22.134.193:37913): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b4f3bfbbbffd4dda8c4e11a231c335d2: Network error: Client connection negotiation failed: client connection to 127.22.134.193:37913: connect: Connection refused (error 111)
I20260810 03:48:04.403788 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 6884
I20260810 03:48:04.413018 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 6469
I20260810 03:48:04.421877 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:32969
--webserver_interface=127.22.134.254
--webserver_port=36557
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:32969
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:04.541163 7085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:04.541466 7085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:04.541509 7085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:04.545754 7085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:48:04.545835 7085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:04.545854 7085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:04.545871 7085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:48:04.545887 7085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:48:04.551491 7085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:32969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:32969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=36557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:04.552668 7085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:04.553763 7085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:04.562800 7097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:04.562816 7094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:04.562973 7085 server_base.cc:1034] running on GCE node
W20260810 03:48:04.562999 7092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:04.563787 7085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:04.564957 7085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:04.566159 7085 hybrid_clock.cc:648] HybridClock initialized: now 1786333684566136 us; error 34 us; skew 500 ppm
Aug 10 03:48:04 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333684, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:04.569442 7085 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:48:04.570459 7085 webserver.cc:460] Webserver started at http://127.22.134.254:36557/ using document root <none> and password file <none>
I20260810 03:48:04.571041 7085 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:04.571106 7085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:04.575421 7085 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:48:04.577899 7106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:04.579360 7085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:04.579540 7085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "6ee91d592dc546e8b18a6e363851bf17"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "909d5fd1184ee42255a355656f35a24a"
server_key_iv: "f6542ad9d9020e92cc098c8a2000f089"
server_key_version: "encryptionkey@0"
I20260810 03:48:04.580268 7085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:04.605173 7085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:04.608604 7085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:04.608857 7085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:04.616362 7085 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:32969
I20260810 03:48:04.616770 7165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:32969 every 8 connection(s)
I20260810 03:48:04.617662 7085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:48:04.619738 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 7085
I20260810 03:48:04.620203 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:37913
--local_ip_for_outbound_sockets=127.22.134.193
--tserver_master_addrs=127.22.134.254:32969
--webserver_port=42483
--webserver_interface=127.22.134.193
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:48:04.622661 7166 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:48:04.625267 7166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Bootstrap starting.
I20260810 03:48:04.651032 7166 log.cc:824] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:04.663651 7166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:48:04.664088 7166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: Bootstrap complete.
I20260810 03:48:04.668310 7166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:04.668772 7166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee91d592dc546e8b18a6e363851bf17, State: Initialized, Role: FOLLOWER
I20260810 03:48:04.669359 7166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:04.669519 7166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:48:04.669612 7166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:48:04.669734 7166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 2 FOLLOWER]: Advancing to term 3
I20260810 03:48:04.671702 7166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:04.672053 7166 leader_election.cc:302] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ee91d592dc546e8b18a6e363851bf17; no voters:
I20260810 03:48:04.672416 7166 leader_election.cc:288] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 03:48:04.672567 7170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 03:48:04.672863 7170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [term 3 LEADER]: Becoming Leader. State: Replica: 6ee91d592dc546e8b18a6e363851bf17, State: Running, Role: LEADER
I20260810 03:48:04.673205 7170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } }
I20260810 03:48:04.673718 7166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:48:04.674809 7172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ee91d592dc546e8b18a6e363851bf17. Latest consensus state: current_term: 3 leader_uuid: "6ee91d592dc546e8b18a6e363851bf17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } } }
I20260810 03:48:04.674877 7171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6ee91d592dc546e8b18a6e363851bf17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee91d592dc546e8b18a6e363851bf17" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32969 } } }
I20260810 03:48:04.674950 7172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:04.674983 7171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:04.679670 7185 catalog_manager.cc:1259] Loaded cluster ID: 70378fb9d5b740a3bb3ec3e6ecad348c
I20260810 03:48:04.679764 7185 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: loading cluster ID for follower catalog manager: success
W20260810 03:48:04.681020 7185 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 6ee91d592dc546e8b18a6e363851bf17: acquiring CA information for follower catalog manager: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
W20260810 03:48:04.681125 7185 catalog_manager.cc:873] Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO: failed to prepare follower catalog manager, will retry
I20260810 03:48:04.681195 7179 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:48:04.684235 7179 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:48:04.684787 7179 catalog_manager.cc:1259] Loaded cluster ID: 70378fb9d5b740a3bb3ec3e6ecad348c
I20260810 03:48:04.684849 7179 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 03:48:04.685600 7179 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8ff5b5b9ad google::LogMessage::Fail() at ??:0
@ 0x7f8ff5b5e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f8ff5b5b4de google::LogMessage::Flush() at ??:0
@ 0x7f8ff5b5ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f900049efdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f900049fd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f900049c579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f90004e0640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f8ff7dad3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8ff7dadc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f8ff7daf3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f8ff7d9e512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8ff93e26db start_thread at ??:0
@ 0x7f8ff465961f clone at ??:0
W20260810 03:48:04.781260 7168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:04.781701 7168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:04.781801 7168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:04.788718 7168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:04.788834 7168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:04.788944 7168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:48:04.798385 7168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:37913
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=42483
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:04.800014 7168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:04.801611 7168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:04.814152 7212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:04.814146 7214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:04.814146 7211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:04.814715 7168 server_base.cc:1034] running on GCE node
I20260810 03:48:04.815178 7168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:04.815903 7168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:04.817091 7168 hybrid_clock.cc:648] HybridClock initialized: now 1786333684817063 us; error 50 us; skew 500 ppm
Aug 10 03:48:04 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333684, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:04.820202 7168 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:48:04.821259 7168 webserver.cc:460] Webserver started at http://127.22.134.193:42483/ using document root <none> and password file <none>
I20260810 03:48:04.821851 7168 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:04.821915 7168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:04.826146 7168 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260810 03:48:04.828606 7221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:04.830300 7168 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:48:04.830430 7168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "d72cf8d9fad448c1b991ec6fda139e8b"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "8d337ce3c208c66bdfa93c02ce9a88e1"
server_key_iv: "ae310221123d00edcc18952a7a64ff0c"
server_key_version: "encryptionkey@0"
I20260810 03:48:04.831022 7168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:04.849833 7168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:04.853456 7168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:04.853696 7168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:04.854363 7168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:04.855593 7230 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 03:48:04.861632 7168 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 03:48:04.861756 7168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260810 03:48:04.861846 7168 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 03:48:04.863654 7168 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 03:48:04.863739 7168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 03:48:04.864069 7230 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Bootstrap starting.
I20260810 03:48:04.875243 7168 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:37913
I20260810 03:48:04.875517 7351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:37913 every 8 connection(s)
I20260810 03:48:04.876341 7168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:48:04.879685 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 7168
I20260810 03:48:04.880160 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:39885
--local_ip_for_outbound_sockets=127.22.134.194
--tserver_master_addrs=127.22.134.254:32969
--webserver_port=41517
--webserver_interface=127.22.134.194
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:48:04.889077 7230 log.cc:824] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:04.899745 7230 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:48:04.900347 7230 tablet_bootstrap.cc:492] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Bootstrap complete.
I20260810 03:48:04.902041 7230 ts_tablet_manager.cc:1397] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Time spent bootstrapping tablet: real 0.038s user 0.029s sys 0.007s
I20260810 03:48:04.906030 7230 raft_consensus.cc:348] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.906643 7230 raft_consensus.cc:729] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72cf8d9fad448c1b991ec6fda139e8b, State: Initialized, Role: FOLLOWER
I20260810 03:48:04.907203 7230 consensus_queue.cc:260] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:04.908321 7230 ts_tablet_manager.cc:1428] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260810 03:48:04.959362 7355 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:48:04.878394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:45561)
0810 03:48:04.878899 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.878956 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:04.880147 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:04.958469 (+ 78322us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":164,"threads_started":1}
W20260810 03:48:04.959867 7352 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:32969 (0 consecutive failures): Network error: Failed to ping master at 127.22.134.254:32969: Client connection negotiation failed: client connection to 127.22.134.254:32969: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 03:48:04.960697 7355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.960382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:58195)
0810 03:48:04.960554 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.960633 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 03:48:04.961537 7355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:04.961284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:51549)
0810 03:48:04.961411 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:04.961469 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260810 03:48:04.961747 7352 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:48:05.016582 7356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:05.017073 7356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:05.017186 7356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:05.026402 7356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:05.026520 7356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:05.026655 7356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:48:05.036573 7356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:39885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=41517
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:05.037775 7356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:05.038865 7356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:05.049206 7368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:05.049206 7365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:05.049217 7366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:05.049747 7356 server_base.cc:1034] running on GCE node
I20260810 03:48:05.050237 7356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:05.050917 7356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:05.052153 7356 hybrid_clock.cc:648] HybridClock initialized: now 1786333685052095 us; error 35 us; skew 500 ppm
Aug 10 03:48:05 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333685, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:05.055089 7356 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:48:05.056066 7356 webserver.cc:460] Webserver started at http://127.22.134.194:41517/ using document root <none> and password file <none>
I20260810 03:48:05.056620 7356 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:05.056685 7356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:05.060832 7356 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:05.063015 7376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:05.064343 7356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:48:05.064445 7356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "c94d6f0e764d461dac8d095737fd8e0a"
format_stamp: "Formatted at 2026-08-10 03:48:02 on dist-test-slave-qg60"
server_key: "b54ec556968f81e7c4c83bcbc634c1a5"
server_key_iv: "48d89e682fc3fafe79f1dbbca163cadc"
server_key_version: "encryptionkey@0"
I20260810 03:48:05.065078 7356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:05.083539 7356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:05.086746 7356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:05.086934 7356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:05.087568 7356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:05.088483 7356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:05.088563 7356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:05.088651 7356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:05.088692 7356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:05.101289 7356 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:39885
I20260810 03:48:05.101306 7510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:39885 every 8 connection(s)
I20260810 03:48:05.102385 7356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:48:05.107359 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:05.104848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:54869)
0810 03:48:05.105415 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:05.105590 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":142,"threads_started":1}
W20260810 03:48:05.108026 7511 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:32969 (0 consecutive failures): Network error: Failed to ping master at 127.22.134.254:32969: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
I20260810 03:48:05.108788 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:05.108507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:44453)
0810 03:48:05.108630 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:05.108688 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 03:48:05.109553 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:05.109355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:37075)
0810 03:48:05.109458 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:05.109502 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:48:05.109752 7511 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 03:48:05.110427 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 7356
I20260810 03:48:05.110874 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:37277
--local_ip_for_outbound_sockets=127.22.134.195
--tserver_master_addrs=127.22.134.254:32969
--webserver_port=42793
--webserver_interface=127.22.134.195
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:05.229399 7514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:05.229691 7514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:05.229735 7514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:05.234584 7514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:05.234666 7514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:05.234772 7514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:48:05.240561 7514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:37277
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=42793
--tserver_master_addrs=127.22.134.254:32969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:05.241746 7514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:05.242791 7514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:05.253079 7523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:05.253079 7520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:05.253083 7519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:05.253505 7514 server_base.cc:1034] running on GCE node
I20260810 03:48:05.253908 7514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:05.254549 7514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:05.255728 7514 hybrid_clock.cc:648] HybridClock initialized: now 1786333685255711 us; error 27 us; skew 500 ppm
Aug 10 03:48:05 dist-test-slave-qg60 krb5kdc[5854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333685, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:05.258648 7514 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:48:05.259694 7514 webserver.cc:460] Webserver started at http://127.22.134.195:42793/ using document root <none> and password file <none>
I20260810 03:48:05.260310 7514 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:05.260376 7514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:05.264535 7514 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:05.266866 7531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:05.268990 7514 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:05.269160 7514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "25849052e18a477cbd377b52cb5e8747"
format_stamp: "Formatted at 2026-08-10 03:48:03 on dist-test-slave-qg60"
server_key: "6638cb0441efc11ef8e3f1df24ac9a85"
server_key_iv: "5989fccf84d9f90ab7cab1bacc2eab03"
server_key_version: "encryptionkey@0"
I20260810 03:48:05.269811 7514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:05.283528 7514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:05.287134 7514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:05.287360 7514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:05.287999 7514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:05.288978 7514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:05.289052 7514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:05.289134 7514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:05.289179 7514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:05.298966 7514 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:37277
I20260810 03:48:05.299070 7664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:37277 every 8 connection(s)
I20260810 03:48:05.300153 7514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:48:05.304538 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:05.302507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:45653)
0810 03:48:05.303124 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:05.303272 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":132,"threads_started":1}
W20260810 03:48:05.305114 7665 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:32969 (0 consecutive failures): Network error: Failed to ping master at 127.22.134.254:32969: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
I20260810 03:48:05.305836 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:05.305570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:34939)
0810 03:48:05.305712 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:05.305776 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 03:48:05.306550 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:05.306343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:40411)
0810 03:48:05.306449 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:05.306498 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:48:05.306775 7665 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 03:48:05.309358 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 7514
I20260810 03:48:05.963068 7669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:05.962553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:35861)
0810 03:48:05.962861 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:05.962929 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":85,"threads_started":1}
I20260810 03:48:06.111060 7670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:06.110423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:59745)
0810 03:48:06.110842 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:06.110919 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":85,"threads_started":1}
I20260810 03:48:06.240706 7671 raft_consensus.cc:482] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:06.241062 7671 raft_consensus.cc:504] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:06.242339 7671 leader_election.cc:288] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885), 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277)
Aug 10 03:48:06 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333684, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.194@KRBTEST.COM
Aug 10 03:48:06 dist-test-slave-qg60 krb5kdc[5854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333684, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.195@KRBTEST.COM
I20260810 03:48:06.264514 7674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:06.242811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:36087 (local address 127.22.134.194:39885)
0810 03:48:06.243222 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:06.243244 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:06.243278 (+ 34us) server_negotiation.cc:407] Connection header received
0810 03:48:06.243998 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:06.244004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:06.244350 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:06.244673 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:06.246013 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:06.247387 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:06.248832 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:06.249358 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:06.249536 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:06.259145 (+ 9609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:06.259152 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:06.259163 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:06.259200 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:06.261687 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:06.262345 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:06.262351 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:06.262355 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:06.262481 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:06.262865 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:06.262869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:06.262871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:06.263329 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:06.263483 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:06.264038 (+ 555us) server_negotiation.cc:299] Negotiation successful
0810 03:48:06.264312 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":114,"threads_started":1}
I20260810 03:48:06.264510 7669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:06.242597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:39885 (local address 127.22.134.193:36087)
0810 03:48:06.242809 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:06.242827 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:06.242942 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:06.244762 (+ 1820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:06.244768 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:06.245352 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:06.245826 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:06.245841 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:06.247566 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:06.247573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:06.248636 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:06.248646 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:06.249497 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:06.249501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:06.249630 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:06.256330 (+ 6700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:06.256365 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:06.258500 (+ 2135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:06.261850 (+ 3350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:06.261856 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:06.261870 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:06.262208 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:06.262593 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:06.262599 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:06.262602 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:06.262753 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:06.263457 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:06.263464 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:06.263709 (+ 245us) client_negotiation.cc:769] Sending connection context
0810 03:48:06.263904 (+ 195us) client_negotiation.cc:240] Negotiation successful
0810 03:48:06.264299 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":95,"spinlock_wait_cycles":3968}
I20260810 03:48:06.264689 7673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:06.242802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:45061 (local address 127.22.134.195:37277)
0810 03:48:06.243222 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:06.243235 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:06.243275 (+ 40us) server_negotiation.cc:407] Connection header received
0810 03:48:06.243999 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:06.244005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:06.244356 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:06.244687 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:06.246102 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:06.247552 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:06.248765 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:06.249277 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:06.249410 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:06.259059 (+ 9649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:06.259069 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:06.259102 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:06.259147 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:06.261688 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:06.262682 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:06.262693 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:06.262697 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:06.262860 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:06.263186 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:06.263195 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:06.263196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:06.263610 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:06.263764 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:06.264150 (+ 386us) server_negotiation.cc:299] Negotiation successful
0810 03:48:06.264483 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":74,"threads_started":1}
I20260810 03:48:06.264678 7672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:06.242627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:37277 (local address 127.22.134.193:45061)
0810 03:48:06.242925 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:06.242937 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:06.243019 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:06.244768 (+ 1749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:06.244772 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:06.245354 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:06.245826 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:06.245842 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:06.247771 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:06.247775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:06.248612 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:06.248624 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:06.249418 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:06.249425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:06.249630 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:06.256336 (+ 6706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:06.256356 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:06.258762 (+ 2406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:06.262315 (+ 3553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:06.262317 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:06.262319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:06.262543 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:06.262976 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:06.262982 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:06.262984 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:06.263073 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:06.263733 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:06.263736 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:06.263845 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 03:48:06.263965 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 03:48:06.264407 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":238,"spinlock_wait_cycles":27392,"thread_start_us":67,"threads_started":1}
W20260810 03:48:06.267835 7224 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
W20260810 03:48:06.268069 7223 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
I20260810 03:48:06.268143 7224 leader_election.cc:302] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d72cf8d9fad448c1b991ec6fda139e8b; no voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a
I20260810 03:48:06.268478 7671 raft_consensus.cc:2726] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:48:06.307888 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:06.307471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:44619)
0810 03:48:06.307730 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:06.307789 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":82,"threads_started":1}
I20260810 03:48:06.964519 7677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:06.964023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:42225)
0810 03:48:06.964331 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:06.964403 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":83,"threads_started":1}
I20260810 03:48:07.113268 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:07.112403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:60973)
0810 03:48:07.112805 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:07.113144 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":98,"threads_started":1}
I20260810 03:48:07.309346 7680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:07.308860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:52219)
0810 03:48:07.309152 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:07.309219 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":94,"threads_started":1}
I20260810 03:48:07.966014 7681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:07.965492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:36323)
0810 03:48:07.965800 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:07.965882 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":89,"threads_started":1}
I20260810 03:48:08.114848 7682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:08.114287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:44665)
0810 03:48:08.114652 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:08.114712 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":99,"threads_started":1}
I20260810 03:48:08.310792 7683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:08.310303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:58529)
0810 03:48:08.310616 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:08.310685 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":90,"threads_started":1}
I20260810 03:48:08.360586 7684 raft_consensus.cc:482] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:08.360837 7684 raft_consensus.cc:504] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:08.361414 7684 leader_election.cc:288] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885), 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277)
W20260810 03:48:08.362370 7224 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
W20260810 03:48:08.362484 7223 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
I20260810 03:48:08.362615 7223 leader_election.cc:302] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d72cf8d9fad448c1b991ec6fda139e8b; no voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a
I20260810 03:48:08.362784 7684 raft_consensus.cc:2726] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:48:08.967545 7685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:08.967074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:58247)
0810 03:48:08.967379 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:08.967444 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":93,"threads_started":1}
I20260810 03:48:09.116192 7686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:09.115742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:41955)
0810 03:48:09.116029 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:09.116095 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":80,"threads_started":1}
I20260810 03:48:09.312353 7687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:09.311820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:42689)
0810 03:48:09.312182 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:09.312252 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":92,"threads_started":1}
I20260810 03:48:09.969338 7688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:09.968718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:44169)
0810 03:48:09.969165 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:09.969236 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":112,"threads_started":1}
I20260810 03:48:10.117632 7689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:10.117124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:50741)
0810 03:48:10.117415 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:10.117482 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260810 03:48:10.193553 7690 raft_consensus.cc:482] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:10.193753 7690 raft_consensus.cc:504] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:10.194309 7690 leader_election.cc:288] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885), 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277)
W20260810 03:48:10.195212 7223 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
W20260810 03:48:10.195362 7224 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
I20260810 03:48:10.195462 7224 leader_election.cc:302] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d72cf8d9fad448c1b991ec6fda139e8b; no voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a
I20260810 03:48:10.195643 7690 raft_consensus.cc:2726] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:48:10.313757 7691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:10.313288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:33033)
0810 03:48:10.313592 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:10.313656 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":99,"threads_started":1}
I20260810 03:48:10.970729 7693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:10.970223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:44745)
0810 03:48:10.970529 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:10.970598 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":108,"threads_started":1}
I20260810 03:48:11.119078 7694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:11.118604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:35817)
0810 03:48:11.118909 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:11.118979 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":111,"threads_started":1}
I20260810 03:48:11.315094 7695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:11.314651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:49379)
0810 03:48:11.314923 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:11.314991 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":87,"threads_started":1}
I20260810 03:48:11.972347 7696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:11.971735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:55353)
0810 03:48:11.972159 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:11.972236 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":84,"threads_started":1}
I20260810 03:48:12.120398 7697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:12.119840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:51539)
0810 03:48:12.120234 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:12.120296 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":80,"threads_started":1}
I20260810 03:48:12.316612 7698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:12.316039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:59611)
0810 03:48:12.316393 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:12.316498 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":110,"threads_started":1}
I20260810 03:48:12.974254 7699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:12.973596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:41235)
0810 03:48:12.973962 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:12.974031 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":171,"threads_started":1}
I20260810 03:48:13.121785 7700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:13.121278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:53883)
0810 03:48:13.121608 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:13.121679 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":106,"threads_started":1}
I20260810 03:48:13.317965 7701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:13.317501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:45835)
0810 03:48:13.317801 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:13.317864 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":97,"threads_started":1}
I20260810 03:48:13.975544 7703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:13.975035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:39889)
0810 03:48:13.975381 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:13.975441 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":135,"threads_started":1}
I20260810 03:48:14.123413 7704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:14.122981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:36265)
0810 03:48:14.123252 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:14.123315 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":85,"threads_started":1}
I20260810 03:48:14.319403 7705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:14.318858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:56239)
0810 03:48:14.319242 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:14.319300 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":103,"threads_started":1}
I20260810 03:48:14.976995 7706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:14.976519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:49047)
0810 03:48:14.976833 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:14.976893 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":81,"threads_started":1}
I20260810 03:48:15.094367 7707 raft_consensus.cc:482] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:15.094551 7707 raft_consensus.cc:504] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:15.095213 7707 leader_election.cc:288] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885), 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277)
W20260810 03:48:15.095885 7224 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
W20260810 03:48:15.096403 7223 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
I20260810 03:48:15.096473 7223 leader_election.cc:302] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d72cf8d9fad448c1b991ec6fda139e8b; no voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a
I20260810 03:48:15.096699 7707 raft_consensus.cc:2726] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:48:15.124846 7708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:15.124324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:57013)
0810 03:48:15.124615 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:15.124678 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":79,"threads_started":1}
I20260810 03:48:15.321095 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:15.320424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:35491)
0810 03:48:15.320841 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:15.320930 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":150,"threads_started":1}
I20260810 03:48:15.978331 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:15.977863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:40267)
0810 03:48:15.978162 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:15.978229 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":92,"threads_started":1}
I20260810 03:48:16.126135 7711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:16.125665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:60635)
0810 03:48:16.125962 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:16.126029 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":80,"threads_started":1}
I20260810 03:48:16.322389 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:16.321935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:41067)
0810 03:48:16.322187 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:16.322251 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":75,"threads_started":1}
I20260810 03:48:16.979779 7713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:16.979332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:46271)
0810 03:48:16.979609 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:16.979677 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":83,"threads_started":1}
I20260810 03:48:17.127503 7714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:17.127035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:34581)
0810 03:48:17.127336 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:17.127398 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":80,"threads_started":1}
I20260810 03:48:17.218020 7715 raft_consensus.cc:482] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:17.218187 7715 raft_consensus.cc:504] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c94d6f0e764d461dac8d095737fd8e0a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 39885 } } peers { permanent_uuid: "25849052e18a477cbd377b52cb5e8747" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 37277 } } peers { permanent_uuid: "d72cf8d9fad448c1b991ec6fda139e8b" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 37913 } }
I20260810 03:48:17.218689 7715 leader_election.cc:288] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885), 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277)
W20260810 03:48:17.219662 7223 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c94d6f0e764d461dac8d095737fd8e0a (127.22.134.194:39885): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
W20260810 03:48:17.219807 7224 leader_election.cc:341] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25849052e18a477cbd377b52cb5e8747 (127.22.134.195:37277): Not found: Tablet not found: b4f3bfbbbffd4dda8c4e11a231c335d2
I20260810 03:48:17.219879 7224 leader_election.cc:302] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d72cf8d9fad448c1b991ec6fda139e8b; no voters: 25849052e18a477cbd377b52cb5e8747, c94d6f0e764d461dac8d095737fd8e0a
I20260810 03:48:17.220021 7715 raft_consensus.cc:2726] T b4f3bfbbbffd4dda8c4e11a231c335d2 P d72cf8d9fad448c1b991ec6fda139e8b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:48:17.323753 7716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:17.323259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:60135)
0810 03:48:17.323566 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:17.323639 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":77,"threads_started":1}
I20260810 03:48:17.981196 7719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:17.980643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:33595)
0810 03:48:17.981024 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:17.981096 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":156,"threads_started":1}
I20260810 03:48:18.128971 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:18.128343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:60151)
0810 03:48:18.128692 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:18.128811 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":86,"threads_started":1}
I20260810 03:48:18.325034 7721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:18.324554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:58543)
0810 03:48:18.324882 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:18.324935 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":98,"threads_started":1}
I20260810 03:48:18.982609 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:18.982103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:43909)
0810 03:48:18.982439 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:18.982506 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":120,"threads_started":1}
I20260810 03:48:19.130301 7723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:19.129837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:51865)
0810 03:48:19.130112 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:19.130180 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":88,"threads_started":1}
I20260810 03:48:19.326306 7724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:19.325856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:51887)
0810 03:48:19.326140 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:19.326205 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":79,"threads_started":1}
I20260810 03:48:19.984321 7725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:19.983850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.193:55967)
0810 03:48:19.984149 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:19.984220 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":83,"threads_started":1}
I20260810 03:48:20.131734 7726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:20.131287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.194:37517)
0810 03:48:20.131573 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:20.131632 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":78,"threads_started":1}
I20260810 03:48:20.320132 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 7168
I20260810 03:48:20.327975 7727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:20.327477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32969 (local address 127.22.134.195:42659)
0810 03:48:20.327801 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:20.327868 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":86,"threads_started":1}
I20260810 03:48:20.329038 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 7356
I20260810 03:48:20.336833 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 7514
2026-08-10T03:48:20Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19545 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:48:20 dist-test-slave-qg60 krb5kdc[7730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:48:20 dist-test-slave-qg60 krb5kdc[7730](info): set up 2 sockets
Aug 10 03:48:20 dist-test-slave-qg60 krb5kdc[7730](info): commencing operation
krb5kdc: starting...
W20260810 03:48:21.494199 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:48:21 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:48:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:48:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:48:21.633621 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42463
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:42463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:21.759074 7748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:21.759383 7748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:21.759425 7748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:21.763702 7748 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 03:48:21.763772 7748 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 03:48:21.763788 7748 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 03:48:21.763801 7748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:48:21.763820 7748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:21.763839 7748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:21.763854 7748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:48:21.763870 7748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:48:21.769371 7748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:42463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:21.770493 7748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:21.771553 7748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:21.781284 7754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:21.781277 7755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:21.781353 7748 server_base.cc:1034] running on GCE node
W20260810 03:48:21.781277 7757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:21.782207 7748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:21.783393 7748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:21.784571 7748 hybrid_clock.cc:648] HybridClock initialized: now 1786333701784535 us; error 49 us; skew 500 ppm
Aug 10 03:48:21 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333701, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:21.787479 7748 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:48:21.788523 7748 webserver.cc:460] Webserver started at http://127.22.134.254:36285/ using document root <none> and password file <none>
I20260810 03:48:21.789222 7748 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:21.789321 7748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:21.789558 7748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:21.791713 7748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "925c3c57077349898f6d4cca6d8a6c61"
format_stamp: "Formatted at 2026-08-10 03:48:21 on dist-test-slave-qg60"
server_key: "e5c97ae13b5cce5cf87933fe08629743"
server_key_iv: "c23190848ef1b37e0b67e2d9b3bd535a"
server_key_version: "encryptionkey@0"
I20260810 03:48:21.792290 7748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "925c3c57077349898f6d4cca6d8a6c61"
format_stamp: "Formatted at 2026-08-10 03:48:21 on dist-test-slave-qg60"
server_key: "e5c97ae13b5cce5cf87933fe08629743"
server_key_iv: "c23190848ef1b37e0b67e2d9b3bd535a"
server_key_version: "encryptionkey@0"
I20260810 03:48:21.796241 7748 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:48:21.799022 7765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:21.800467 7748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 03:48:21.800793 7748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "925c3c57077349898f6d4cca6d8a6c61"
format_stamp: "Formatted at 2026-08-10 03:48:21 on dist-test-slave-qg60"
server_key: "e5c97ae13b5cce5cf87933fe08629743"
server_key_iv: "c23190848ef1b37e0b67e2d9b3bd535a"
server_key_version: "encryptionkey@0"
I20260810 03:48:21.800942 7748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:21.825431 7748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:21.828902 7748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:21.829131 7748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:21.836922 7748 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:42463
I20260810 03:48:21.837234 7824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:42463 every 8 connection(s)
I20260810 03:48:21.838060 7748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:48:21.840955 7825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:21.841655 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 7748
I20260810 03:48:21.841753 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:48:21.842072 23067 external_mini_cluster.cc:1428] Setting key cfe350cb1176e476d25319d42248bd69
I20260810 03:48:21.847224 7825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Bootstrap starting.
I20260810 03:48:21.849718 7825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:21.850538 7825 log.cc:824] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:48:21 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:21.853091 7825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: No bootstrap required, opened a new log
I20260810 03:48:21.857084 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:21.843568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34206 (local address 127.22.134.254:42463)
0810 03:48:21.844016 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:21.844031 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:21.844067 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:48:21.844842 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:21.844862 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:21.845203 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:21.845566 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:21.846395 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:21.847424 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:21.848308 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:21.848851 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:21.849027 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:21.851770 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:21.851776 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:21.851793 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:21.851822 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:21.853827 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:21.854248 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:21.854253 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:21.854260 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:21.854396 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:21.854647 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:21.854650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:21.854651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:21.855201 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:21.855405 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:21.855726 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 03:48:21.856050 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":135,"threads_started":1}
I20260810 03:48:21.857774 7825 raft_consensus.cc:348] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:48:21.858017 7825 raft_consensus.cc:374] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:21.858086 7825 raft_consensus.cc:729] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925c3c57077349898f6d4cca6d8a6c61, State: Initialized, Role: FOLLOWER
I20260810 03:48:21.858552 7825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:48:21.858708 7825 raft_consensus.cc:388] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:48:21.858764 7825 raft_consensus.cc:482] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:48:21.858850 7825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:21.859963 7825 raft_consensus.cc:504] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:48:21.860304 7825 leader_election.cc:302] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 925c3c57077349898f6d4cca6d8a6c61; no voters:
I20260810 03:48:21.860631 7825 leader_election.cc:288] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:48:21.860811 7831 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:48:21.861081 7831 raft_consensus.cc:686] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 1 LEADER]: Becoming Leader. State: Replica: 925c3c57077349898f6d4cca6d8a6c61, State: Running, Role: LEADER
I20260810 03:48:21.861496 7831 consensus_queue.cc:237] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:48:21.862521 7825 sys_catalog.cc:564] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:48:21.863308 7832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "925c3c57077349898f6d4cca6d8a6c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } } }
I20260810 03:48:21.863449 7832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:21.863888 7837 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:48:21.863880 7833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 925c3c57077349898f6d4cca6d8a6c61. Latest consensus state: current_term: 1 leader_uuid: "925c3c57077349898f6d4cca6d8a6c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } } }
I20260810 03:48:21.866267 7833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:21.867327 7837 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:48:21.873500 7837 catalog_manager.cc:1347] Generated new cluster ID: f99ef0f1335342a282e0d1e5182c5c62
I20260810 03:48:21.873672 7837 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:48:21.894536 7837 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:48:21.895762 7837 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:48:21.906080 7837 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Generated new TSK 0
I20260810 03:48:21.907109 7837 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:48:21.940582 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42463
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:22.062558 7853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:22.062902 7853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:22.063015 7853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:22.067474 7853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:22.067581 7853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:22.067679 7853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:48:22.073235 7853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:22.074405 7853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:22.075522 7853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:22.085937 7858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:22.085983 7861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:22.086167 7853 server_base.cc:1034] running on GCE node
W20260810 03:48:22.086401 7859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:22.086951 7853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:22.087769 7853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:22.088976 7853 hybrid_clock.cc:648] HybridClock initialized: now 1786333702088942 us; error 45 us; skew 500 ppm
Aug 10 03:48:22 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:22.092213 7853 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:48:22.093329 7853 webserver.cc:460] Webserver started at http://127.22.134.193:40355/ using document root <none> and password file <none>
I20260810 03:48:22.093978 7853 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:22.094082 7853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:22.094349 7853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:22.096676 7853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "614be2b582ad42aa9c8cbc66c807d383"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "287bab882344566465dde06fb32ae512"
server_key_iv: "e6ec6f3dbfbb99d9174283c80c2f5205"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.097393 7853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "614be2b582ad42aa9c8cbc66c807d383"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "287bab882344566465dde06fb32ae512"
server_key_iv: "e6ec6f3dbfbb99d9174283c80c2f5205"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.102249 7853 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 03:48:22.105331 7868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.106735 7853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:22.106890 7853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "614be2b582ad42aa9c8cbc66c807d383"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "287bab882344566465dde06fb32ae512"
server_key_iv: "e6ec6f3dbfbb99d9174283c80c2f5205"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.107005 7853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:22.121767 7853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:22.125537 7853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:22.125777 7853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:22.126453 7853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:22.127339 7853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:22.127411 7853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.127485 7853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:22.127524 7853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.136982 7853 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:46117
I20260810 03:48:22.137005 7995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:46117 every 8 connection(s)
I20260810 03:48:22.137910 7853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:48:22.139137 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 7853
I20260810 03:48:22.139287 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:48:22.139657 23067 external_mini_cluster.cc:1428] Setting key 025181a2096e7c4e4ff7ca459900cf38
Aug 10 03:48:22 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:48:22.154153 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.140127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:40763 (local address 127.22.134.254:42463)
0810 03:48:22.140302 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.140306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.141038 (+ 732us) server_negotiation.cc:407] Connection header received
0810 03:48:22.142511 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.142518 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.142584 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.142692 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:22.144285 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.144891 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.146745 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.146976 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.147056 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.150190 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:22.150193 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:22.150195 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:22.150221 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:22.151799 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:22.152419 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:22.152422 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:22.152424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:22.152515 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:22.152916 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:22.152919 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:22.152920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:22.153167 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:22.153253 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.153863 (+ 610us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.153999 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:48:22.155169 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.140380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:40763)
0810 03:48:22.140885 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.140941 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:22.142282 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:22.142839 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:22.142846 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:22.143373 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:22.144101 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.144124 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.145021 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.145028 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.146594 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.146609 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.147136 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.147139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.147322 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.148055 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:22.148072 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:22.149988 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:22.151919 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:22.151924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:22.151939 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:22.152299 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:22.152598 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:22.152600 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:22.152602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:22.152807 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:22.153264 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:22.153270 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:22.153603 (+ 333us) client_negotiation.cc:769] Sending connection context
0810 03:48:22.153801 (+ 198us) client_negotiation.cc:240] Negotiation successful
0810 03:48:22.154092 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":126,"threads_started":1}
I20260810 03:48:22.156641 7996 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42463
I20260810 03:48:22.156965 7996 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:22.157498 7996 heartbeater.cc:511] Master 127.22.134.254:42463 requested a full tablet report, sending...
I20260810 03:48:22.159149 7785 ts_manager.cc:194] Registered new tserver with Master: 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117)
I20260810 03:48:22.160377 7785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:40763
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:48:22.172721 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42463
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:22.291772 8001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:22.292112 8001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:22.292189 8001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:22.296375 8001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:22.296478 8001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:22.296576 8001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:48:22.302284 8001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:22.303470 8001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:22.304677 8001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:22.315111 8008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:22.315361 8001 server_base.cc:1034] running on GCE node
W20260810 03:48:22.315129 8007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:22.315129 8010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:22.315898 8001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:22.316522 8001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:22.317708 8001 hybrid_clock.cc:648] HybridClock initialized: now 1786333702317674 us; error 49 us; skew 500 ppm
Aug 10 03:48:22 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:22.320691 8001 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:48:22.321625 8001 webserver.cc:460] Webserver started at http://127.22.134.194:37875/ using document root <none> and password file <none>
I20260810 03:48:22.322187 8001 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:22.322247 8001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:22.322420 8001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:22.324496 8001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "e0eb88374aa74329bd96362c3c6c744a"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "bd5d777f7402b4ddd125f7156d35d603"
server_key_iv: "c3c590a4dae20364a5c11255de5995b2"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.325115 8001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "e0eb88374aa74329bd96362c3c6c744a"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "bd5d777f7402b4ddd125f7156d35d603"
server_key_iv: "c3c590a4dae20364a5c11255de5995b2"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.329346 8001 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:48:22.332072 8017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.333583 8001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:22.333748 8001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "e0eb88374aa74329bd96362c3c6c744a"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "bd5d777f7402b4ddd125f7156d35d603"
server_key_iv: "c3c590a4dae20364a5c11255de5995b2"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.333884 8001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:22.348215 8001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:22.351791 8001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:22.352015 8001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:22.352640 8001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:22.353580 8001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:22.353650 8001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.353726 8001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:22.353766 8001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.363436 8001 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:40855
I20260810 03:48:22.363509 8146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:40855 every 8 connection(s)
I20260810 03:48:22.364526 8001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:48:22.371532 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 8001
I20260810 03:48:22.371673 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:48:22.371982 23067 external_mini_cluster.cc:1428] Setting key 97775d555e289ef7fb0fdd3f471ffc29
Aug 10 03:48:22 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:22.380206 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.366542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:50439 (local address 127.22.134.254:42463)
0810 03:48:22.366705 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.366708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.367559 (+ 851us) server_negotiation.cc:407] Connection header received
0810 03:48:22.368976 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.368979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.369028 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.369105 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:22.370308 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.370835 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.372317 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.372642 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.372780 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.375696 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:22.375703 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:22.375709 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:22.375747 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:22.377545 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:22.378121 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:22.378127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:22.378132 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:22.378242 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:22.378657 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:22.378664 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:22.378668 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:22.378975 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:22.379095 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.379774 (+ 679us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.379940 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:48:22.381008 8150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.366958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:50439)
0810 03:48:22.367402 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.367447 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:22.368714 (+ 1267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:22.369279 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:22.369285 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:22.369688 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:22.370179 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.370192 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.370942 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.370945 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.372198 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.372210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.372847 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.372851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.373003 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.373731 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:22.373754 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:22.375500 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:22.377699 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:22.377705 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:22.377719 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:22.378011 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:22.378381 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:22.378384 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:22.378385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:22.378543 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:22.379154 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:22.379164 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:22.379486 (+ 322us) client_negotiation.cc:769] Sending connection context
0810 03:48:22.379687 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 03:48:22.379980 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":115,"threads_started":1}
I20260810 03:48:22.382288 8147 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42463
I20260810 03:48:22.382589 8147 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:22.383283 8147 heartbeater.cc:511] Master 127.22.134.254:42463 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:48:22.384563 7785 ts_manager.cc:194] Registered new tserver with Master: e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855)
I20260810 03:48:22.385301 7785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:50439
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:48:22.405097 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42463
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:22.522368 8154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:22.522701 8154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:22.522791 8154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:22.527740 8154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:22.527835 8154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:22.527936 8154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:48:22.534137 8154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:22.535359 8154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:22.536540 8154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:48:22.547453 8154 server_base.cc:1034] running on GCE node
W20260810 03:48:22.547498 8159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:22.547498 8162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:22.547781 8160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:22.548324 8154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:22.549080 8154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:22.550268 8154 hybrid_clock.cc:648] HybridClock initialized: now 1786333702550253 us; error 26 us; skew 500 ppm
Aug 10 03:48:22 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:22.553510 8154 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:48:22.554517 8154 webserver.cc:460] Webserver started at http://127.22.134.195:43453/ using document root <none> and password file <none>
I20260810 03:48:22.555174 8154 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:22.555248 8154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:22.555528 8154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:48:22.557997 8154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "a37acfa41dd24ba9b74fe6217a93c7c5"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "e5724cfc5e476fe6c48be8c58b6034bf"
server_key_iv: "3a1531c8837760ab0aaf4359c1a5b20b"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.558624 8154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "a37acfa41dd24ba9b74fe6217a93c7c5"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "e5724cfc5e476fe6c48be8c58b6034bf"
server_key_iv: "3a1531c8837760ab0aaf4359c1a5b20b"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.562932 8154 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:48:22.565748 8171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.567320 8154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:48:22.567488 8154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "a37acfa41dd24ba9b74fe6217a93c7c5"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "e5724cfc5e476fe6c48be8c58b6034bf"
server_key_iv: "3a1531c8837760ab0aaf4359c1a5b20b"
server_key_version: "encryptionkey@0"
I20260810 03:48:22.567634 8154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:22.586324 8154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:22.589695 8154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:22.589906 8154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:22.590541 8154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:22.591413 8154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:22.591488 8154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.591565 8154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:22.591610 8154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:22.601753 8154 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:40709
I20260810 03:48:22.601818 8302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:40709 every 8 connection(s)
I20260810 03:48:22.603183 8154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:48:22.613494 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 8154
I20260810 03:48:22.613654 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:48:22.613927 23067 external_mini_cluster.cc:1428] Setting key cf5866d6746d45cceea1c2efa14a1e95
Aug 10 03:48:22 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:22.619154 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.607720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:58143 (local address 127.22.134.254:42463)
0810 03:48:22.607918 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.607925 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.607947 (+ 22us) server_negotiation.cc:407] Connection header received
0810 03:48:22.609214 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.609218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.609278 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.609361 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:22.610616 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.611219 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.612357 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.612576 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.612660 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.615746 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:22.615750 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:22.615753 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:22.615781 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:22.617233 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:22.617770 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:22.617772 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:22.617774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:22.617852 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:22.618187 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:22.618190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:22.618191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:22.618365 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:22.618443 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.618921 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.619027 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 03:48:22.620023 8306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.606235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:58143)
0810 03:48:22.607131 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.607209 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:22.608878 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:22.609504 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:22.609511 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:22.609897 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:22.610416 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.610431 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.611343 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.611346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.612247 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.612257 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.612707 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.612710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.612919 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.613649 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:22.613671 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:22.615558 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:22.617343 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:22.617349 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:22.617362 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:22.617673 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:22.617951 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:22.617954 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:22.617955 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:22.618100 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:22.618454 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:22.618459 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:22.618718 (+ 259us) client_negotiation.cc:769] Sending connection context
0810 03:48:22.618881 (+ 163us) client_negotiation.cc:240] Negotiation successful
0810 03:48:22.619141 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":389,"threads_started":1}
I20260810 03:48:22.621284 8303 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42463
I20260810 03:48:22.621498 8303 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:22.621955 8303 heartbeater.cc:511] Master 127.22.134.254:42463 requested a full tablet report, sending...
I20260810 03:48:22.622988 7785 ts_manager.cc:194] Registered new tserver with Master: a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
I20260810 03:48:22.623625 7785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:58143
I20260810 03:48:22.627904 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:48:22.637502 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.630011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34222 (local address 127.22.134.254:42463)
0810 03:48:22.630137 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.630141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.630324 (+ 183us) server_negotiation.cc:407] Connection header received
0810 03:48:22.630434 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.630436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.630472 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.630543 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:22.631221 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.631737 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.632576 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.632835 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.632917 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.634354 (+ 1437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:22.634358 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:22.634360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:22.634384 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:22.635742 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:22.636135 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:22.636138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:22.636139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:22.636220 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:22.636490 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:22.636493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:22.636494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:22.636799 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:22.636923 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.637225 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.637328 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 03:48:22.640549 7785 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34222:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:48:22.643628 7785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:48:22.659022 8321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.653530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50000 (local address 127.22.134.195:40709)
0810 03:48:22.653983 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.653995 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.654346 (+ 351us) server_negotiation.cc:407] Connection header received
0810 03:48:22.654452 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.654457 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.654720 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.654872 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:22.655123 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.656202 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.657695 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.658283 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.658428 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.658580 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.658747 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.658851 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":143,"threads_started":1}
I20260810 03:48:22.659011 8317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.652793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:40709 (local address 127.0.0.1:50000)
0810 03:48:22.654220 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.654234 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:22.654342 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:22.654858 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:22.654861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:22.654879 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:22.654992 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.654998 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.656332 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.656336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.657566 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.657576 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.658413 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.658417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.658527 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.658565 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 03:48:22.658712 (+ 147us) client_negotiation.cc:240] Negotiation successful
0810 03:48:22.658851 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1368,"mutex_wait_us":68,"thread_start_us":127,"threads_started":1}
I20260810 03:48:22.659528 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.653706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58800 (local address 127.22.134.194:40855)
0810 03:48:22.654068 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.654079 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.654656 (+ 577us) server_negotiation.cc:407] Connection header received
0810 03:48:22.654792 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.654817 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.654996 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.655142 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:22.655334 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.656245 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.657794 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.658618 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.658728 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.658854 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.659257 (+ 403us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.659355 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":96,"threads_started":1}
I20260810 03:48:22.659827 8319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.652883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52290 (local address 127.22.134.193:46117)
0810 03:48:22.653212 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.653230 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.653731 (+ 501us) server_negotiation.cc:407] Connection header received
0810 03:48:22.653839 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.653847 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.654063 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.654225 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:22.654777 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.656023 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.657794 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.658619 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.658746 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.658854 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.659591 (+ 737us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.659693 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":102,"threads_started":1}
I20260810 03:48:22.660080 8320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.653502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40855 (local address 127.0.0.1:58800)
0810 03:48:22.654548 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.654560 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:22.654680 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:22.655136 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:22.655138 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:22.655156 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:22.655237 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.655243 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.656398 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.656401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.657644 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.657652 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.658945 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.658948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.659074 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.659090 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 03:48:22.659686 (+ 596us) client_negotiation.cc:240] Negotiation successful
0810 03:48:22.659946 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"mutex_wait_us":169,"thread_start_us":96,"threads_started":1}
I20260810 03:48:22.660207 8315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.652687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46117 (local address 127.0.0.1:52290)
0810 03:48:22.653367 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.653423 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:22.653557 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:22.654437 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:22.654443 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:22.654470 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:22.654632 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.654639 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.656149 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.656153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.657636 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.657654 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.658926 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.658930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.659056 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.659082 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:48:22.659541 (+ 459us) client_negotiation.cc:240] Negotiation successful
0810 03:48:22.660043 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":173,"thread_start_us":129,"threads_started":1}
I20260810 03:48:22.662578 7925 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe488718ab5448984f43526fe8a8168 (DEFAULT_TABLE table=test-table [id=cffca9fda536446c8bd71fca4cc8b322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:22.662679 8074 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe488718ab5448984f43526fe8a8168 (DEFAULT_TABLE table=test-table [id=cffca9fda536446c8bd71fca4cc8b322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:22.662581 8229 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe488718ab5448984f43526fe8a8168 (DEFAULT_TABLE table=test-table [id=cffca9fda536446c8bd71fca4cc8b322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:22.663786 8229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe488718ab5448984f43526fe8a8168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:22.663782 8074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe488718ab5448984f43526fe8a8168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:22.663790 7925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe488718ab5448984f43526fe8a8168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:22.670305 8323 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Bootstrap starting.
I20260810 03:48:22.671751 8324 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: Bootstrap starting.
I20260810 03:48:22.673075 8325 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Bootstrap starting.
I20260810 03:48:22.673228 8323 tablet_bootstrap.cc:654] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:22.673961 8324 tablet_bootstrap.cc:654] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:22.673974 8323 log.cc:824] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:22.675343 8324 log.cc:824] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:22.675827 8325 tablet_bootstrap.cc:654] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:22.675940 8323 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: No bootstrap required, opened a new log
I20260810 03:48:22.676158 8323 ts_tablet_manager.cc:1397] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:48:22.676632 8325 log.cc:824] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:22.677682 8324 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: No bootstrap required, opened a new log
I20260810 03:48:22.677884 8324 ts_tablet_manager.cc:1397] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:48:22.679301 8325 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: No bootstrap required, opened a new log
I20260810 03:48:22.679495 8325 ts_tablet_manager.cc:1397] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 03:48:22.680190 8323 raft_consensus.cc:348] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.680444 8323 raft_consensus.cc:374] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:22.680507 8323 raft_consensus.cc:729] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614be2b582ad42aa9c8cbc66c807d383, State: Initialized, Role: FOLLOWER
I20260810 03:48:22.681000 8323 consensus_queue.cc:260] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.681694 7996 heartbeater.cc:503] Master 127.22.134.254:42463 was elected leader, sending a full tablet report...
I20260810 03:48:22.682088 8323 ts_tablet_manager.cc:1428] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260810 03:48:22.681931 8324 raft_consensus.cc:348] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.682199 8324 raft_consensus.cc:374] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:22.682260 8324 raft_consensus.cc:729] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a37acfa41dd24ba9b74fe6217a93c7c5, State: Initialized, Role: FOLLOWER
I20260810 03:48:22.682947 8324 consensus_queue.cc:260] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.683355 8325 raft_consensus.cc:348] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.683633 8303 heartbeater.cc:503] Master 127.22.134.254:42463 was elected leader, sending a full tablet report...
I20260810 03:48:22.683713 8325 raft_consensus.cc:374] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:22.683765 8325 raft_consensus.cc:729] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0eb88374aa74329bd96362c3c6c744a, State: Initialized, Role: FOLLOWER
I20260810 03:48:22.684033 8324 ts_tablet_manager.cc:1428] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 03:48:22.684351 8325 consensus_queue.cc:260] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.685523 8147 heartbeater.cc:503] Master 127.22.134.254:42463 was elected leader, sending a full tablet report...
I20260810 03:48:22.685634 8325 ts_tablet_manager.cc:1428] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260810 03:48:22.720500 8332 raft_consensus.cc:482] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:22.720839 8332 raft_consensus.cc:504] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.722069 8332 leader_election.cc:288] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117), a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
I20260810 03:48:22.726495 8150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.722448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:40709 (local address 127.22.134.194:34669)
0810 03:48:22.722600 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.722620 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:22.722746 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:22.723051 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:22.723054 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:22.723070 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:22.723220 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.723228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.724172 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.724175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.725117 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.725127 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.726020 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.726024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.726136 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.726164 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 03:48:22.726246 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 03:48:22.726324 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 03:48:22.726483 8321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.722585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:34669 (local address 127.22.134.195:40709)
0810 03:48:22.722771 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.722776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.722795 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:48:22.722875 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.722878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.722933 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.723031 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:22.723342 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.724045 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.725250 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.725908 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.726016 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.726062 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.726270 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.726334 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 03:48:22.727094 8319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.722778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:35465 (local address 127.22.134.193:46117)
0810 03:48:22.722916 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.722920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.723127 (+ 207us) server_negotiation.cc:407] Connection header received
0810 03:48:22.723265 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.723271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.723331 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.723405 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:22.723746 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.724340 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.725789 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.726343 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.726458 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.726512 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.726777 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.726889 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:48:22.727346 8252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe488718ab5448984f43526fe8a8168" candidate_uuid: "e0eb88374aa74329bd96362c3c6c744a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" is_pre_election: true
I20260810 03:48:22.727459 8333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.722448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46117 (local address 127.22.134.194:35465)
0810 03:48:22.723028 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.723044 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:22.723152 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:22.723439 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:22.723443 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:22.723462 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:22.723630 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.723638 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.724499 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.724503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.725652 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:22.725664 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.726464 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.726468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:22.726594 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.726627 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:48:22.727267 (+ 640us) client_negotiation.cc:240] Negotiation successful
0810 03:48:22.727347 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":65,"thread_start_us":147,"threads_started":1}
I20260810 03:48:22.727742 8252 raft_consensus.cc:2454] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0eb88374aa74329bd96362c3c6c744a in term 0.
I20260810 03:48:22.728113 7946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe488718ab5448984f43526fe8a8168" candidate_uuid: "e0eb88374aa74329bd96362c3c6c744a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614be2b582ad42aa9c8cbc66c807d383" is_pre_election: true
I20260810 03:48:22.728420 8018 leader_election.cc:302] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a37acfa41dd24ba9b74fe6217a93c7c5, e0eb88374aa74329bd96362c3c6c744a; no voters:
I20260810 03:48:22.728466 7946 raft_consensus.cc:2454] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0eb88374aa74329bd96362c3c6c744a in term 0.
I20260810 03:48:22.728793 8332 raft_consensus.cc:2781] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:48:22.728904 8332 raft_consensus.cc:482] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:48:22.729008 8332 raft_consensus.cc:3037] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:22.730268 8332 raft_consensus.cc:504] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.730654 8332 leader_election.cc:288] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [CANDIDATE]: Term 1 election: Requested vote from peers 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117), a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
I20260810 03:48:22.731052 8252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe488718ab5448984f43526fe8a8168" candidate_uuid: "e0eb88374aa74329bd96362c3c6c744a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5"
I20260810 03:48:22.731101 7946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe488718ab5448984f43526fe8a8168" candidate_uuid: "e0eb88374aa74329bd96362c3c6c744a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614be2b582ad42aa9c8cbc66c807d383"
I20260810 03:48:22.731211 8252 raft_consensus.cc:3037] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:22.731257 7946 raft_consensus.cc:3037] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:22.732311 8252 raft_consensus.cc:2454] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0eb88374aa74329bd96362c3c6c744a in term 1.
I20260810 03:48:22.732411 7946 raft_consensus.cc:2454] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0eb88374aa74329bd96362c3c6c744a in term 1.
I20260810 03:48:22.732612 8018 leader_election.cc:302] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a37acfa41dd24ba9b74fe6217a93c7c5, e0eb88374aa74329bd96362c3c6c744a; no voters:
I20260810 03:48:22.732815 8332 raft_consensus.cc:2781] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:48:22.733062 8332 raft_consensus.cc:686] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 1 LEADER]: Becoming Leader. State: Replica: e0eb88374aa74329bd96362c3c6c744a, State: Running, Role: LEADER
I20260810 03:48:22.733379 8332 consensus_queue.cc:237] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:22.737099 7783 catalog_manager.cc:5495] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a reported cstate change: term changed from 0 to 1, leader changed from <none> to e0eb88374aa74329bd96362c3c6c744a (127.22.134.194). New cstate: current_term: 1 leader_uuid: "e0eb88374aa74329bd96362c3c6c744a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } health_report { overall_health: HEALTHY } } }
I20260810 03:48:22.762625 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.758748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58812 (local address 127.22.134.194:40855)
0810 03:48:22.758916 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:22.758922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:22.758943 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:48:22.759021 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:22.759023 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:22.759081 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:22.759211 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:48:22.759458 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.759970 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.760892 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:22.761105 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:22.761239 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:22.761557 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:48:22.762023 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:48:22.762165 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:22.762365 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 03:48:22.762432 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:48:22.769145 8252 raft_consensus.cc:1261] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 FOLLOWER]: Refusing update from remote peer e0eb88374aa74329bd96362c3c6c744a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:48:22.769151 7946 raft_consensus.cc:1261] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Refusing update from remote peer e0eb88374aa74329bd96362c3c6c744a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:48:22.769912 8332 consensus_queue.cc:1035] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:48:22.770107 8334 consensus_queue.cc:1035] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [LEADER]: Connected to new peer: Peer: permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:48:22.778589 8337 mvcc.cc:205] Tried to move back new op lower bound from 7316822846534590464 to 7316822846398717952. Current Snapshot: MvccSnapshot[applied={T|T < 7316822846534590464}]
I20260810 03:48:22.778702 8339 mvcc.cc:205] Tried to move back new op lower bound from 7316822846534590464 to 7316822846398717952. Current Snapshot: MvccSnapshot[applied={T|T < 7316822846534590464}]
I20260810 03:48:22.779008 8338 mvcc.cc:205] Tried to move back new op lower bound from 7316822846534590464 to 7316822846398717952. Current Snapshot: MvccSnapshot[applied={T|T < 7316822846534590464}]
I20260810 03:48:22.789377 7783 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:48:22.789577 7783 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:48:22.792538 7783 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Sending DeleteTablet for 3 replicas of tablet 7fe488718ab5448984f43526fe8a8168
I20260810 03:48:22.793623 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 7853
I20260810 03:48:22.793627 8229 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fe488718ab5448984f43526fe8a8168 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:22 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:50000
I20260810 03:48:22.793625 7925 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fe488718ab5448984f43526fe8a8168 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:22 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:52290
I20260810 03:48:22.795303 8348 tablet_replica.cc:330] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: stopping tablet replica
I20260810 03:48:22.795634 8348 raft_consensus.cc:2229] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:48:22.795933 8348 raft_consensus.cc:2258] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:22.797415 8074 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fe488718ab5448984f43526fe8a8168 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:22 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:58800
I20260810 03:48:22.798771 8348 ts_tablet_manager.cc:1905] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:22.801005 8349 tablet_replica.cc:330] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: stopping tablet replica
I20260810 03:48:22.801399 8348 ts_tablet_manager.cc:1918] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:22.801528 8348 log.cc:1196] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/7fe488718ab5448984f43526fe8a8168
I20260810 03:48:22.801463 8349 raft_consensus.cc:2229] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:48:22.801879 8348 ts_tablet_manager.cc:1939] T 7fe488718ab5448984f43526fe8a8168 P a37acfa41dd24ba9b74fe6217a93c7c5: Deleting consensus metadata
I20260810 03:48:22.802275 8349 raft_consensus.cc:2258] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:22.803375 7767 catalog_manager.cc:4841] TS a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709): tablet 7fe488718ab5448984f43526fe8a8168 (table test-table [id=cffca9fda536446c8bd71fca4cc8b322]) successfully deleted
I20260810 03:48:22.804036 8349 ts_tablet_manager.cc:1905] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 03:48:22.806416 7769 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:46117 (error 108)
I20260810 03:48:22.806701 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 8001
I20260810 03:48:22.813151 8320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.812579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46117 (local address 127.0.0.1:52298)
0810 03:48:22.812918 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.813023 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260810 03:48:22.813390 7769 catalog_manager.cc:4584] TS 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7fe488718ab5448984f43526fe8a8168: Network error: Client connection negotiation failed: client connection to 127.22.134.193:46117: connect: Connection refused (error 111)
I20260810 03:48:22.817534 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 8154
I20260810 03:48:22.819626 8320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:22.817806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40855 (local address 127.0.0.1:58818)
0810 03:48:22.819424 (+ 1618us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:22.819509 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.194:40855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1500}
I20260810 03:48:22.824834 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 7748
I20260810 03:48:42.834148 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42463
--webserver_interface=127.22.134.254
--webserver_port=36285
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:42463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:48:42.950965 8351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:42.951261 8351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:42.951303 8351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:42.955453 8351 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 03:48:42.955521 8351 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 03:48:42.955538 8351 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 03:48:42.955552 8351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:48:42.955570 8351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:42.955595 8351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:42.955612 8351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:48:42.955679 8351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:48:42.961977 8351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:42463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=36285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:42.963165 8351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:42.964253 8351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:42.979245 8360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:42.979245 8358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:42.979384 8351 server_base.cc:1034] running on GCE node
W20260810 03:48:42.979306 8357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:42.980435 8351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:42.981989 8351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:42.983300 8351 hybrid_clock.cc:648] HybridClock initialized: now 1786333722983252 us; error 63 us; skew 500 ppm
Aug 10 03:48:42 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333722, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:42.986665 8351 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:48:42.987716 8351 webserver.cc:460] Webserver started at http://127.22.134.254:36285/ using document root <none> and password file <none>
I20260810 03:48:42.988408 8351 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:42.988530 8351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:42.993085 8351 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:48:42.995702 8368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:42.997375 8351 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:42.997557 8351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "925c3c57077349898f6d4cca6d8a6c61"
format_stamp: "Formatted at 2026-08-10 03:48:21 on dist-test-slave-qg60"
server_key: "e5c97ae13b5cce5cf87933fe08629743"
server_key_iv: "c23190848ef1b37e0b67e2d9b3bd535a"
server_key_version: "encryptionkey@0"
I20260810 03:48:42.998270 8351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:43.012351 8351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:43.017145 8351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:43.017416 8351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:43.025564 8351 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:42463
I20260810 03:48:43.025862 8425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:42463 every 8 connection(s)
I20260810 03:48:43.026868 8351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:48:43.031957 8426 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:48:43.032871 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 8351
I20260810 03:48:43.033331 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:46117
--local_ip_for_outbound_sockets=127.22.134.193
--tserver_master_addrs=127.22.134.254:42463
--webserver_port=40355
--webserver_interface=127.22.134.193
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:48:43.034078 8426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Bootstrap starting.
I20260810 03:48:43.052450 8426 log.cc:824] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:43.062093 8426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:48:43.062533 8426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Bootstrap complete.
I20260810 03:48:43.066856 8426 raft_consensus.cc:348] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:48:43.067312 8426 raft_consensus.cc:729] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925c3c57077349898f6d4cca6d8a6c61, State: Initialized, Role: FOLLOWER
I20260810 03:48:43.067858 8426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:48:43.068015 8426 raft_consensus.cc:388] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:48:43.068120 8426 raft_consensus.cc:482] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:48:43.068248 8426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 1 FOLLOWER]: Advancing to term 2
I20260810 03:48:43.070387 8426 raft_consensus.cc:504] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:48:43.070765 8426 leader_election.cc:302] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 925c3c57077349898f6d4cca6d8a6c61; no voters:
I20260810 03:48:43.071158 8426 leader_election.cc:288] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 03:48:43.071306 8431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 03:48:43.071576 8431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 2 LEADER]: Becoming Leader. State: Replica: 925c3c57077349898f6d4cca6d8a6c61, State: Running, Role: LEADER
I20260810 03:48:43.071902 8431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:48:43.072453 8426 sys_catalog.cc:564] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:48:43.072962 8433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 925c3c57077349898f6d4cca6d8a6c61. Latest consensus state: current_term: 2 leader_uuid: "925c3c57077349898f6d4cca6d8a6c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } } }
I20260810 03:48:43.073087 8433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:43.073366 8432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "925c3c57077349898f6d4cca6d8a6c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } } }
I20260810 03:48:43.073458 8436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:48:43.073477 8432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: This master's current role is: LEADER
I20260810 03:48:43.078464 8436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:48:43.079222 8436 catalog_manager.cc:1259] Loaded cluster ID: f99ef0f1335342a282e0d1e5182c5c62
I20260810 03:48:43.079286 8436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:48:43.081836 8436 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:48:43.082753 8436 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Loaded TSK: 0
I20260810 03:48:43.096256 8436 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Generated new TSK 1
I20260810 03:48:43.096589 8436 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:48:43.159973 8428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:43.160269 8428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:43.160352 8428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:43.164609 8428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:43.164702 8428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:43.164880 8428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:48:43.170605 8428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:46117
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=40355
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:43.171803 8428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:43.173013 8428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:43.183663 8455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:43.183714 8457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:43.184016 8428 server_base.cc:1034] running on GCE node
W20260810 03:48:43.183728 8459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:43.184475 8428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:43.185230 8428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:43.186426 8428 hybrid_clock.cc:648] HybridClock initialized: now 1786333723186414 us; error 33 us; skew 500 ppm
Aug 10 03:48:43 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333723, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:43.189618 8428 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:48:43.190703 8428 webserver.cc:460] Webserver started at http://127.22.134.193:40355/ using document root <none> and password file <none>
I20260810 03:48:43.191318 8428 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:43.191437 8428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:43.195649 8428 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:48:43.198032 8468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:43.199421 8428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:48:43.199529 8428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "614be2b582ad42aa9c8cbc66c807d383"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "287bab882344566465dde06fb32ae512"
server_key_iv: "e6ec6f3dbfbb99d9174283c80c2f5205"
server_key_version: "encryptionkey@0"
I20260810 03:48:43.200138 8428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:43.227573 8428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:43.231685 8428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:43.231932 8428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:43.232635 8428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:43.233798 8477 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 03:48:43.238174 8428 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 03:48:43.238246 8428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260810 03:48:43.238324 8428 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 03:48:43.240031 8428 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 03:48:43.240079 8428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 03:48:43.240406 8477 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Bootstrap starting.
I20260810 03:48:43.251065 8428 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:46117
I20260810 03:48:43.251190 8600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:46117 every 8 connection(s)
I20260810 03:48:43.252111 8428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:48:43.259713 8477 log.cc:824] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:43.262154 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 8428
I20260810 03:48:43.262713 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:40855
--local_ip_for_outbound_sockets=127.22.134.194
--tserver_master_addrs=127.22.134.254:42463
--webserver_port=37875
--webserver_interface=127.22.134.194
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:48:43 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333723, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:43.268098 8477 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:48:43.268561 8477 tablet_bootstrap.cc:492] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Bootstrap complete.
I20260810 03:48:43.270155 8477 ts_tablet_manager.cc:1397] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Time spent bootstrapping tablet: real 0.030s user 0.021s sys 0.007s
I20260810 03:48:43.271412 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.255957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:44445 (local address 127.22.134.254:42463)
0810 03:48:43.256757 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.256793 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.256868 (+ 75us) server_negotiation.cc:407] Connection header received
0810 03:48:43.257220 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.257231 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.257532 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.257858 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:43.259020 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.260080 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.261336 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.261794 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.261988 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.264670 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:43.264678 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:43.264697 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:43.264762 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:43.267159 (+ 2397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.267866 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.267872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.267878 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.268033 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.268444 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.268450 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.268453 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.269137 (+ 684us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:43.269294 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:43.270124 (+ 830us) server_negotiation.cc:299] Negotiation successful
0810 03:48:43.270517 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":174,"threads_started":1}
I20260810 03:48:43.271485 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.254353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:44445)
0810 03:48:43.255356 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:43.255414 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:43.256532 (+ 1118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:43.257910 (+ 1378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:43.257917 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:43.258364 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:43.258837 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.258852 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.260252 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.260255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.261199 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.261209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.261950 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.261955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.262138 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.262880 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:43.262908 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:43.264392 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:43.267307 (+ 2915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:43.267312 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:43.267326 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:43.267688 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:43.268153 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:43.268157 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:43.268160 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:43.268338 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:43.269363 (+ 1025us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:43.269371 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:43.269729 (+ 358us) client_negotiation.cc:769] Sending connection context
0810 03:48:43.269984 (+ 255us) client_negotiation.cc:240] Negotiation successful
0810 03:48:43.270387 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"thread_start_us":148,"threads_started":1}
I20260810 03:48:43.273185 8477 raft_consensus.cc:348] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:43.273737 8477 raft_consensus.cc:729] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614be2b582ad42aa9c8cbc66c807d383, State: Initialized, Role: FOLLOWER
I20260810 03:48:43.274307 8477 consensus_queue.cc:260] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } }
I20260810 03:48:43.274796 8601 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42463
I20260810 03:48:43.275058 8601 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:43.275405 8477 ts_tablet_manager.cc:1428] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 03:48:43.275712 8601 heartbeater.cc:511] Master 127.22.134.254:42463 requested a full tablet report, sending...
I20260810 03:48:43.278673 8386 ts_manager.cc:194] Registered new tserver with Master: 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117)
I20260810 03:48:43.282706 8386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:44445
I20260810 03:48:43.285567 8601 heartbeater.cc:503] Master 127.22.134.254:42463 was elected leader, sending a full tablet report...
Aug 10 03:48:43 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333722, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.193@KRBTEST.COM
I20260810 03:48:43.294265 8610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.281798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46117 (local address 127.0.0.1:50224)
0810 03:48:43.282283 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:43.282345 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:43.282501 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:43.284002 (+ 1501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:43.284008 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:43.284473 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:43.284622 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.284639 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.286104 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.286108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.287137 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.287149 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.287783 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.287787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.287914 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.288778 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:43.288794 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:43.290315 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:43.292273 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:43.292285 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:43.292290 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:43.292540 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:43.292931 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:43.292934 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:43.292936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:43.293038 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:43.293520 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:43.293526 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:43.293671 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 03:48:43.293815 (+ 144us) client_negotiation.cc:240] Negotiation successful
0810 03:48:43.294054 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":137,"threads_started":1}
I20260810 03:48:43.294265 8611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.281900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50224 (local address 127.22.134.193:46117)
0810 03:48:43.283538 (+ 1638us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.283549 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.283568 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:48:43.283629 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.283632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.283836 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.283977 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:43.284797 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.285836 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.287266 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.287628 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.287715 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.290464 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:43.290479 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:43.290489 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:43.290516 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:43.292151 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.292663 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.292674 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.292676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.292827 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.293133 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.293138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.293139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.293401 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:43.293555 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:43.293920 (+ 365us) server_negotiation.cc:299] Negotiation successful
0810 03:48:43.294104 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1542,"spinlock_wait_cycles":39168,"thread_start_us":100,"threads_started":1}
I20260810 03:48:43.295353 8523 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fe488718ab5448984f43526fe8a8168 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:22 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:50224
I20260810 03:48:43.296392 8612 tablet_replica.cc:330] stopping tablet replica
I20260810 03:48:43.296707 8612 raft_consensus.cc:2229] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:48:43.297019 8612 raft_consensus.cc:2258] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:43.298056 8612 ts_tablet_manager.cc:1905] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:43.301684 8612 ts_tablet_manager.cc:1918] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:43.301815 8612 log.cc:1196] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal/wals/7fe488718ab5448984f43526fe8a8168
I20260810 03:48:43.302110 8612 ts_tablet_manager.cc:1939] T 7fe488718ab5448984f43526fe8a8168 P 614be2b582ad42aa9c8cbc66c807d383: Deleting consensus metadata
I20260810 03:48:43.304064 8371 catalog_manager.cc:4841] TS 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117): tablet 7fe488718ab5448984f43526fe8a8168 (table test-table [id=cffca9fda536446c8bd71fca4cc8b322]) successfully deleted
W20260810 03:48:43.389052 8608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:43.389354 8608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:43.389405 8608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:43.394202 8608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:43.394279 8608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:43.394340 8608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:48:43.399816 8608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:40855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=37875
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:43.401007 8608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:43.402004 8608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:43.412199 8617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:43.412169 8618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:43.412226 8620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:43.412485 8608 server_base.cc:1034] running on GCE node
I20260810 03:48:43.412999 8608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:43.413724 8608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:43.414891 8608 hybrid_clock.cc:648] HybridClock initialized: now 1786333723414864 us; error 40 us; skew 500 ppm
Aug 10 03:48:43 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333723, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:43.418047 8608 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:48:43.419025 8608 webserver.cc:460] Webserver started at http://127.22.134.194:37875/ using document root <none> and password file <none>
I20260810 03:48:43.419618 8608 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:43.419766 8608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:43.424008 8608 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:48:43.426420 8629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:43.427742 8608 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:48:43.427884 8608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "e0eb88374aa74329bd96362c3c6c744a"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "bd5d777f7402b4ddd125f7156d35d603"
server_key_iv: "c3c590a4dae20364a5c11255de5995b2"
server_key_version: "encryptionkey@0"
I20260810 03:48:43.428524 8608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:43.445996 8608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:43.449558 8608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:43.449798 8608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:43.450445 8608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:43.451979 8636 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260810 03:48:43.456085 8636 ts_tablet_manager.cc:1852] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260810 03:48:43.456504 8636 ts_tablet_manager.cc:1905] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:43.460579 8636 ts_tablet_manager.cc:1918] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:43.460701 8636 log.cc:1196] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/7fe488718ab5448984f43526fe8a8168
I20260810 03:48:43.461129 8636 ts_tablet_manager.cc:1939] T 7fe488718ab5448984f43526fe8a8168 P e0eb88374aa74329bd96362c3c6c744a: Deleting consensus metadata
I20260810 03:48:43.461506 8608 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260810 03:48:43.461601 8608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.010s user 0.001s sys 0.000s
I20260810 03:48:43.461689 8608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:43.461736 8608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:43.471967 8608 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:40855
I20260810 03:48:43.472898 8757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:40855 every 8 connection(s)
I20260810 03:48:43.473232 8608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:48:43.482299 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 8608
I20260810 03:48:43.482776 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:40709
--local_ip_for_outbound_sockets=127.22.134.195
--tserver_master_addrs=127.22.134.254:42463
--webserver_port=43453
--webserver_interface=127.22.134.195
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 03:48:43 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333723, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:43.489293 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.475425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:49825 (local address 127.22.134.254:42463)
0810 03:48:43.475594 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.475600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.476546 (+ 946us) server_negotiation.cc:407] Connection header received
0810 03:48:43.477701 (+ 1155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.477703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.477757 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.477838 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:43.479165 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.479726 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.481041 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.481304 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.481408 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.484605 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:43.484610 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:43.484616 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:43.484658 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:43.486547 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.487215 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.487221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.487226 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.487336 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.487782 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.487788 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.487793 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.488119 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:43.488245 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:43.488915 (+ 670us) server_negotiation.cc:299] Negotiation successful
0810 03:48:43.489098 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:48:43.490226 8760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.475908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:49825)
0810 03:48:43.476377 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:43.476423 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:43.477403 (+ 980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:43.478033 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:43.478042 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:43.478427 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:43.478951 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.478966 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.479874 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.479877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.480910 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.480921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.481473 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.481476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.481646 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.482480 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:43.482504 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:43.484397 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:43.486700 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:43.486706 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:43.486720 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:43.487089 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:43.487466 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:43.487468 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:43.487470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:43.487661 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:43.488272 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:43.488281 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:43.488577 (+ 296us) client_negotiation.cc:769] Sending connection context
0810 03:48:43.488867 (+ 290us) client_negotiation.cc:240] Negotiation successful
0810 03:48:43.489347 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":121,"threads_started":1}
I20260810 03:48:43.491588 8758 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42463
I20260810 03:48:43.491873 8758 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:43.492388 8758 heartbeater.cc:511] Master 127.22.134.254:42463 requested a full tablet report, sending...
I20260810 03:48:43.493597 8386 ts_manager.cc:194] Registered new tserver with Master: e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855)
I20260810 03:48:43.494534 8386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:49825
W20260810 03:48:43.602767 8761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:48:43.603070 8761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:48:43.603117 8761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:48:43.607625 8761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:48:43.607704 8761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:48:43.607797 8761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:48:43.613688 8761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:40709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=43453
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:48:43.614856 8761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:48:43.615935 8761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:48:43.626255 8772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:43.626255 8768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:48:43.626690 8769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:48:43.626754 8761 server_base.cc:1034] running on GCE node
I20260810 03:48:43.627197 8761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:48:43.627874 8761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:48:43.629041 8761 hybrid_clock.cc:648] HybridClock initialized: now 1786333723629015 us; error 39 us; skew 500 ppm
Aug 10 03:48:43 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333723, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:48:43.632357 8761 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:48:43.633541 8761 webserver.cc:460] Webserver started at http://127.22.134.195:43453/ using document root <none> and password file <none>
I20260810 03:48:43.634194 8761 fs_manager.cc:359] Metadata directory not provided
I20260810 03:48:43.634323 8761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:48:43.638787 8761 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:48:43.641227 8782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:43.642663 8761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:48:43.642815 8761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "a37acfa41dd24ba9b74fe6217a93c7c5"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "e5724cfc5e476fe6c48be8c58b6034bf"
server_key_iv: "3a1531c8837760ab0aaf4359c1a5b20b"
server_key_version: "encryptionkey@0"
I20260810 03:48:43.643409 8761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:48:43.662473 8761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:48:43.666126 8761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:48:43.666388 8761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:48:43.667074 8761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:48:43.668006 8761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:48:43.668092 8761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:43.668185 8761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:48:43.668236 8761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:48:43.678548 8761 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:40709
I20260810 03:48:43.678637 8905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:40709 every 8 connection(s)
I20260810 03:48:43.679708 8761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:48:43.682216 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 8761
Aug 10 03:48:43 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333723, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:48:43.692673 8911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.682968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33602 (local address 127.22.134.254:42463)
0810 03:48:43.683229 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.683232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.683340 (+ 108us) server_negotiation.cc:407] Connection header received
0810 03:48:43.683507 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.683511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.683606 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.683693 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:43.684785 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.685428 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.686633 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.686890 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.687052 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.688546 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:43.688550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:43.688553 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:43.688580 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:43.690363 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.690903 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.690906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.690908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.691012 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.691375 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.691379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.691381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.691627 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:43.691813 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:43.692135 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 03:48:43.692260 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":101,"threads_started":1}
I20260810 03:48:43.696003 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.681737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:43047 (local address 127.22.134.254:42463)
0810 03:48:43.681939 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.681945 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.683524 (+ 1579us) server_negotiation.cc:407] Connection header received
0810 03:48:43.685269 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.685272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.685314 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.685396 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:43.687004 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.687601 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.689050 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.689273 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.689388 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.692225 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:43.692230 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:43.692232 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:43.692255 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:43.693911 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.694460 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.694470 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.694472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.694590 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.695028 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.695031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.695033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.695209 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:43.695292 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:43.695797 (+ 505us) server_negotiation.cc:299] Negotiation successful
0810 03:48:43.695891 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 03:48:43.696965 8909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.682209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:43047)
0810 03:48:43.683363 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:43.683421 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:43.685060 (+ 1639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:43.685667 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:43.685677 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:43.686194 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:48:43.686839 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.686855 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.687748 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.687756 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.688901 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.688915 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.689433 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.689437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.689625 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.690142 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:48:43.690158 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:48:43.691973 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:48:43.694043 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:43.694049 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:43.694066 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:43.694339 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:43.694711 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:48:43.694714 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:48:43.694716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:48:43.694891 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:48:43.695332 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:48:43.695338 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:48:43.695578 (+ 240us) client_negotiation.cc:769] Sending connection context
0810 03:48:43.695750 (+ 172us) client_negotiation.cc:240] Negotiation successful
0810 03:48:43.696009 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":167,"threads_started":1}
I20260810 03:48:43.698233 8906 heartbeater.cc:347] Connected to a master server at 127.22.134.254:42463
I20260810 03:48:43.698493 8906 heartbeater.cc:464] Registering TS with master...
I20260810 03:48:43.699003 8906 heartbeater.cc:511] Master 127.22.134.254:42463 requested a full tablet report, sending...
I20260810 03:48:43.700075 8386 ts_manager.cc:194] Registered new tserver with Master: a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
I20260810 03:48:43.700703 8386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:43047
I20260810 03:48:43.707266 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:48:43.711856 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.707962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33606 (local address 127.22.134.254:42463)
0810 03:48:43.708088 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.708091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.708326 (+ 235us) server_negotiation.cc:407] Connection header received
0810 03:48:43.708477 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.708479 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.708583 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.708682 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:48:43.709056 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.709616 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.710514 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.710768 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.710887 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.711227 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:48:43.711374 (+ 147us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 03:48:43.711698 (+ 324us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33606: token expired
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 03:48:43.711956 8605 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33606: token expired
W20260810 03:48:43.712260 8309 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.134.254:42463)
I20260810 03:48:43.721016 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.712715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33612 (local address 127.22.134.254:42463)
0810 03:48:43.712848 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.712851 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.712883 (+ 32us) server_negotiation.cc:407] Connection header received
0810 03:48:43.713119 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.713122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.713170 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.713257 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:48:43.713920 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.714561 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.715451 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.715673 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.715758 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.717389 (+ 1631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:48:43.717392 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:48:43.717394 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:48:43.717420 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:48:43.719117 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.719622 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.719624 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.719625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.719736 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:48:43.720145 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:48:43.720147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:48:43.720148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:48:43.720332 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:48:43.720442 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:43.720720 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 03:48:43.720889 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:48:43.723889 8386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:48:43.727615 8386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:48:43.736407 8523 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa989a042bd4a02bfdc273c8fc3adfe (DEFAULT_TABLE table=test-table [id=f9bf7d46e3744b3f9764f18f5c0a8b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:43.737167 8523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa989a042bd4a02bfdc273c8fc3adfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:43.739787 8477 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Bootstrap starting.
I20260810 03:48:43.740715 8477 tablet_bootstrap.cc:654] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:43.741144 8610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.735219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40855 (local address 127.0.0.1:39658)
0810 03:48:43.735342 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:43.735361 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:43.735454 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:43.736431 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:43.736434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:43.736452 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:43.736550 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.736555 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.738159 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.738162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.739440 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.739451 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.740667 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.740670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.740787 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.740838 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 03:48:43.740905 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 03:48:43.740986 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 03:48:43.741261 8916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.735483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39658 (local address 127.22.134.194:40855)
0810 03:48:43.735823 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.735836 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.735863 (+ 27us) server_negotiation.cc:407] Connection header received
0810 03:48:43.735952 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.735958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.736212 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.736428 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:43.736659 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.738043 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.739564 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.740553 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.740700 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.740881 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:43.740949 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 03:48:43.741043 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":141,"threads_started":1}
I20260810 03:48:43.741935 8918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.735563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:40709 (local address 127.0.0.1:55094)
0810 03:48:43.736710 (+ 1147us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:43.736722 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:43.737010 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:43.737801 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:43.737803 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:43.737820 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:43.737895 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.737899 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.739433 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.739439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.740428 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:43.740439 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.741526 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.741529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:43.741625 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.741647 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:48:43.741734 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 03:48:43.741807 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":111,"threads_started":1}
I20260810 03:48:43.742005 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:43.735986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55094 (local address 127.22.134.195:40709)
0810 03:48:43.736320 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:43.736337 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:43.736848 (+ 511us) server_negotiation.cc:407] Connection header received
0810 03:48:43.737351 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:43.737357 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:43.737573 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:43.737985 (+ 412us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:43.738149 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.739276 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.740560 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:43.741415 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:43.741546 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:43.741665 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:43.741781 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 03:48:43.741868 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":162,"threads_started":1}
I20260810 03:48:43.742695 8477 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: No bootstrap required, opened a new log
I20260810 03:48:43.742782 8477 ts_tablet_manager.cc:1397] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 03:48:43.743321 8477 raft_consensus.cc:348] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:43.743448 8477 raft_consensus.cc:374] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:43.743486 8477 raft_consensus.cc:729] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614be2b582ad42aa9c8cbc66c807d383, State: Initialized, Role: FOLLOWER
I20260810 03:48:43.743613 8477 consensus_queue.cc:260] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:43.743269 8683 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa989a042bd4a02bfdc273c8fc3adfe (DEFAULT_TABLE table=test-table [id=f9bf7d46e3744b3f9764f18f5c0a8b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:43.743894 8477 ts_tablet_manager.cc:1428] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 03:48:43.744451 8683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa989a042bd4a02bfdc273c8fc3adfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:43.745774 8834 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa989a042bd4a02bfdc273c8fc3adfe (DEFAULT_TABLE table=test-table [id=f9bf7d46e3744b3f9764f18f5c0a8b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:48:43.746682 8834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa989a042bd4a02bfdc273c8fc3adfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:48:43.749487 8636 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Bootstrap starting.
I20260810 03:48:43.751688 8636 tablet_bootstrap.cc:654] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:43.752385 8636 log.cc:824] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Log is configured to *not* fsync() on all Append() calls
W20260810 03:48:43.753365 8602 tablet.cc:2369] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:48:43.754626 8636 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: No bootstrap required, opened a new log
I20260810 03:48:43.754817 8636 ts_tablet_manager.cc:1397] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:48:43.755328 8923 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Bootstrap starting.
I20260810 03:48:43.757378 8923 tablet_bootstrap.cc:654] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Neither blocks nor log segments found. Creating new log.
I20260810 03:48:43.757992 8636 raft_consensus.cc:348] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:43.758248 8636 raft_consensus.cc:374] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:43.758329 8636 raft_consensus.cc:729] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0eb88374aa74329bd96362c3c6c744a, State: Initialized, Role: FOLLOWER
I20260810 03:48:43.758649 8923 log.cc:824] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Log is configured to *not* fsync() on all Append() calls
I20260810 03:48:43.758790 8636 consensus_queue.cc:260] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:43.759519 8758 heartbeater.cc:503] Master 127.22.134.254:42463 was elected leader, sending a full tablet report...
I20260810 03:48:43.759868 8636 ts_tablet_manager.cc:1428] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 03:48:43.761003 8923 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: No bootstrap required, opened a new log
I20260810 03:48:43.761231 8923 ts_tablet_manager.cc:1397] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 03:48:43.764516 8923 raft_consensus.cc:348] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:43.764835 8923 raft_consensus.cc:374] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:48:43.764900 8923 raft_consensus.cc:729] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a37acfa41dd24ba9b74fe6217a93c7c5, State: Initialized, Role: FOLLOWER
I20260810 03:48:43.765322 8923 consensus_queue.cc:260] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:43.765965 8906 heartbeater.cc:503] Master 127.22.134.254:42463 was elected leader, sending a full tablet report...
I20260810 03:48:43.766232 8923 ts_tablet_manager.cc:1428] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260810 03:48:43.930778 8908 tablet.cc:2369] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:48:43.974542 8759 tablet.cc:2369] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:48:44.177850 8928 raft_consensus.cc:482] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:48:44.178139 8928 raft_consensus.cc:504] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:44.179338 8928 leader_election.cc:288] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855), 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117)
I20260810 03:48:44.184190 8916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:44.179859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:34773 (local address 127.22.134.194:40855)
0810 03:48:44.179989 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:44.180010 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:44.180033 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:48:44.180195 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:44.180199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:44.180255 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:44.180353 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:44.180681 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.181451 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.182973 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.183614 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.183739 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:44.183790 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:44.183970 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 03:48:44.184055 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:48:44.184221 8909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:44.179758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40855 (local address 127.22.134.195:34773)
0810 03:48:44.179892 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:44.179911 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:44.180034 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:44.180394 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:44.180397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:44.180416 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:44.180559 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:44.180567 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.181564 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.181567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:44.182838 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:44.182849 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.183729 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.183732 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:44.183811 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:44.183832 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 03:48:44.183929 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 03:48:44.184005 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":3}
I20260810 03:48:44.184324 8931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:44.180203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:43769 (local address 127.22.134.193:46117)
0810 03:48:44.180497 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:44.180501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:44.180521 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:48:44.180573 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:44.180575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:44.180648 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:44.180792 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:48:44.181094 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.181772 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.183123 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.183788 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.183921 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:44.184086 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:44.184122 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 03:48:44.184187 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":100,"threads_started":1}
I20260810 03:48:44.184233 8929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:44.180051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46117 (local address 127.22.134.195:43769)
0810 03:48:44.180410 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:44.180423 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:48:44.180501 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:48:44.180817 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:48:44.180823 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:48:44.180846 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:48:44.180959 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:44.180966 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.181870 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.181873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:44.183007 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:48:44.183013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.183903 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.183908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:48:44.184003 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:44.184022 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 03:48:44.184080 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 03:48:44.184131 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":21,"thread_start_us":155,"threads_started":1}
I20260810 03:48:44.185005 8708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa989a042bd4a02bfdc273c8fc3adfe" candidate_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0eb88374aa74329bd96362c3c6c744a" is_pre_election: true
I20260810 03:48:44.184979 8547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa989a042bd4a02bfdc273c8fc3adfe" candidate_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614be2b582ad42aa9c8cbc66c807d383" is_pre_election: true
I20260810 03:48:44.185307 8547 raft_consensus.cc:2454] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a37acfa41dd24ba9b74fe6217a93c7c5 in term 0.
I20260810 03:48:44.185307 8708 raft_consensus.cc:2454] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a37acfa41dd24ba9b74fe6217a93c7c5 in term 0.
I20260810 03:48:44.185801 8786 leader_election.cc:302] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614be2b582ad42aa9c8cbc66c807d383, a37acfa41dd24ba9b74fe6217a93c7c5; no voters:
I20260810 03:48:44.186062 8928 raft_consensus.cc:2781] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:48:44.186208 8928 raft_consensus.cc:482] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:48:44.186287 8928 raft_consensus.cc:3037] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:44.187383 8928 raft_consensus.cc:504] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:44.187737 8928 leader_election.cc:288] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [CANDIDATE]: Term 1 election: Requested vote from peers e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855), 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117)
I20260810 03:48:44.188269 8708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa989a042bd4a02bfdc273c8fc3adfe" candidate_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0eb88374aa74329bd96362c3c6c744a"
I20260810 03:48:44.188299 8547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa989a042bd4a02bfdc273c8fc3adfe" candidate_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614be2b582ad42aa9c8cbc66c807d383"
I20260810 03:48:44.188421 8547 raft_consensus.cc:3037] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:44.188421 8708 raft_consensus.cc:3037] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:48:44.189795 8708 raft_consensus.cc:2454] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a37acfa41dd24ba9b74fe6217a93c7c5 in term 1.
I20260810 03:48:44.189795 8547 raft_consensus.cc:2454] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a37acfa41dd24ba9b74fe6217a93c7c5 in term 1.
I20260810 03:48:44.190140 8786 leader_election.cc:302] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614be2b582ad42aa9c8cbc66c807d383, a37acfa41dd24ba9b74fe6217a93c7c5; no voters:
I20260810 03:48:44.190316 8928 raft_consensus.cc:2781] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:48:44.190565 8928 raft_consensus.cc:686] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 LEADER]: Becoming Leader. State: Replica: a37acfa41dd24ba9b74fe6217a93c7c5, State: Running, Role: LEADER
I20260810 03:48:44.190991 8928 consensus_queue.cc:237] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:48:44.194440 8384 catalog_manager.cc:5495] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } health_report { overall_health: UNKNOWN } } }
I20260810 03:48:44.208263 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:44.204667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55096 (local address 127.22.134.195:40709)
0810 03:48:44.204828 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:48:44.204833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:48:44.204848 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:48:44.204972 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:48:44.204975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:48:44.205028 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:48:44.205154 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:48:44.205410 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.205911 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.206743 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:48:44.206963 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:48:44.207070 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:48:44.207385 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:48:44.207814 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:48:44.207950 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 03:48:44.207998 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 03:48:44.208080 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 03:48:44.214629 8708 raft_consensus.cc:1261] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 1 FOLLOWER]: Refusing update from remote peer a37acfa41dd24ba9b74fe6217a93c7c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:48:44.214610 8547 raft_consensus.cc:1261] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Refusing update from remote peer a37acfa41dd24ba9b74fe6217a93c7c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:48:44.215415 8932 consensus_queue.cc:1035] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:48:44.215643 8928 consensus_queue.cc:1035] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:48:44.221354 8935 mvcc.cc:205] Tried to move back new op lower bound from 7316822934374055936 to 7316822934288941056. Current Snapshot: MvccSnapshot[applied={T|T < 7316822934374055936}]
I20260810 03:48:44.225350 8936 mvcc.cc:205] Tried to move back new op lower bound from 7316822934374055936 to 7316822934288941056. Current Snapshot: MvccSnapshot[applied={T|T < 7316822934374055936}]
I20260810 03:48:44.226575 8937 mvcc.cc:205] Tried to move back new op lower bound from 7316822934374055936 to 7316822934288941056. Current Snapshot: MvccSnapshot[applied={T|T < 7316822934374055936 or (T in {7316822934374055936})}]
I20260810 03:48:44.230727 8384 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:48:44.230913 8384 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:48:44.233678 8384 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Sending DeleteTablet for 3 replicas of tablet 6aa989a042bd4a02bfdc273c8fc3adfe
I20260810 03:48:44.234526 8523 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aa989a042bd4a02bfdc273c8fc3adfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:44 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:50224
I20260810 03:48:44.234611 8834 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aa989a042bd4a02bfdc273c8fc3adfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:44 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:55094
I20260810 03:48:44.234965 8683 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aa989a042bd4a02bfdc273c8fc3adfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:48:44 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:39658
I20260810 03:48:44.235178 8944 tablet_replica.cc:330] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: stopping tablet replica
I20260810 03:48:44.235230 8945 tablet_replica.cc:330] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: stopping tablet replica
I20260810 03:48:44.235324 8944 raft_consensus.cc:2229] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:48:44.235473 8944 raft_consensus.cc:2258] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:44.235690 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 8428
I20260810 03:48:44.235833 8945 raft_consensus.cc:2229] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:48:44.236332 8945 raft_consensus.cc:2258] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:44.245141 8946 tablet_replica.cc:330] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: stopping tablet replica
I20260810 03:48:44.245596 8946 raft_consensus.cc:2229] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:48:44.245987 8946 raft_consensus.cc:2258] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:48:44.247074 8945 ts_tablet_manager.cc:1905] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:44.247789 8946 ts_tablet_manager.cc:1905] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:48:44.250097 8945 ts_tablet_manager.cc:1918] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:44.250221 8945 log.cc:1196] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/6aa989a042bd4a02bfdc273c8fc3adfe
I20260810 03:48:44.250564 8945 ts_tablet_manager.cc:1939] T 6aa989a042bd4a02bfdc273c8fc3adfe P a37acfa41dd24ba9b74fe6217a93c7c5: Deleting consensus metadata
I20260810 03:48:44.251375 8946 ts_tablet_manager.cc:1918] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:48:44.251484 8946 log.cc:1196] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/6aa989a042bd4a02bfdc273c8fc3adfe
W20260810 03:48:44.251696 8371 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:46117 (error 108)
I20260810 03:48:44.251860 8946 ts_tablet_manager.cc:1939] T 6aa989a042bd4a02bfdc273c8fc3adfe P e0eb88374aa74329bd96362c3c6c744a: Deleting consensus metadata
I20260810 03:48:44.252096 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 8608
I20260810 03:48:44.252477 8369 catalog_manager.cc:4841] TS a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709): tablet 6aa989a042bd4a02bfdc273c8fc3adfe (table test-table [id=f9bf7d46e3744b3f9764f18f5c0a8b8e]) successfully deleted
I20260810 03:48:44.257205 8948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:44.253093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46117 (local address 127.0.0.1:53166)
0810 03:48:44.256980 (+ 3887us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:44.257075 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3790,"thread_start_us":77,"threads_started":1}
W20260810 03:48:44.257376 8371 catalog_manager.cc:4584] TS 614be2b582ad42aa9c8cbc66c807d383 (127.22.134.193:46117): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6aa989a042bd4a02bfdc273c8fc3adfe: Network error: Client connection negotiation failed: client connection to 127.22.134.193:46117: connect: Connection refused (error 111)
I20260810 03:48:44.267467 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 8761
I20260810 03:48:44.267788 8948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:48:44.267455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40855 (local address 127.0.0.1:39660)
0810 03:48:44.267616 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 03:48:44.267687 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.194:40855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 03:48:44.276991 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 8351
I20260810 03:49:04.287220 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42463
--webserver_interface=127.22.134.254
--webserver_port=36285
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:42463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:04.410147 8949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:04.410481 8949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:04.410560 8949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:04.414816 8949 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 03:49:04.414896 8949 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 03:49:04.414921 8949 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 03:49:04.414945 8949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:04.415148 8949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:04.415248 8949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:04.415292 8949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:04.415331 8949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:04.420965 8949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:42463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:42463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=36285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:04.422066 8949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:04.423101 8949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:04.432125 8955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:04.432072 8958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:04.432447 8949 server_base.cc:1034] running on GCE node
W20260810 03:49:04.432072 8956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:04.433146 8949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:04.434326 8949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:04.435531 8949 hybrid_clock.cc:648] HybridClock initialized: now 1786333744435504 us; error 43 us; skew 500 ppm
Aug 10 03:49:04 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333744, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:04.444131 8949 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:04.445312 8949 webserver.cc:460] Webserver started at http://127.22.134.254:36285/ using document root <none> and password file <none>
I20260810 03:49:04.445923 8949 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:04.446024 8949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:04.450127 8949 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:49:04.452384 8966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:04.453925 8949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:49:04.454074 8949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "925c3c57077349898f6d4cca6d8a6c61"
format_stamp: "Formatted at 2026-08-10 03:48:21 on dist-test-slave-qg60"
server_key: "e5c97ae13b5cce5cf87933fe08629743"
server_key_iv: "c23190848ef1b37e0b67e2d9b3bd535a"
server_key_version: "encryptionkey@0"
I20260810 03:49:04.454633 8949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:04.472774 8949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:04.476363 8949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:04.476542 8949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:04.484046 8949 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:42463
I20260810 03:49:04.484380 9026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:42463 every 8 connection(s)
I20260810 03:49:04.485287 8949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:04.485635 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 8949
I20260810 03:49:04.486152 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:46117
--local_ip_for_outbound_sockets=127.22.134.193
--tserver_master_addrs=127.22.134.254:42463
--webserver_port=40355
--webserver_interface=127.22.134.193
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:49:04.489907 9027 sys_catalog.cc:263] Verifying existing consensus state
I20260810 03:49:04.491786 9027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Bootstrap starting.
I20260810 03:49:04.510846 9027 log.cc:824] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:04.522831 9027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:49:04.523290 9027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Bootstrap complete.
I20260810 03:49:04.527529 9027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:49:04.527951 9027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925c3c57077349898f6d4cca6d8a6c61, State: Initialized, Role: FOLLOWER
I20260810 03:49:04.528462 9027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:49:04.528682 9027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:04.528779 9027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:04.528903 9027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 2 FOLLOWER]: Advancing to term 3
I20260810 03:49:04.530988 9027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:49:04.531344 9027 leader_election.cc:302] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 925c3c57077349898f6d4cca6d8a6c61; no voters:
I20260810 03:49:04.531720 9027 leader_election.cc:288] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 03:49:04.531814 9032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 03:49:04.532032 9032 raft_consensus.cc:686] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [term 3 LEADER]: Becoming Leader. State: Replica: 925c3c57077349898f6d4cca6d8a6c61, State: Running, Role: LEADER
I20260810 03:49:04.532410 9032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } }
I20260810 03:49:04.533303 9027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:04.533982 9033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "925c3c57077349898f6d4cca6d8a6c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } } }
I20260810 03:49:04.534166 9033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:04.534902 9034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 925c3c57077349898f6d4cca6d8a6c61. Latest consensus state: current_term: 3 leader_uuid: "925c3c57077349898f6d4cca6d8a6c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925c3c57077349898f6d4cca6d8a6c61" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 42463 } } }
I20260810 03:49:04.534999 9034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:04.535305 9038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:04.540505 9038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:04.541539 9038 catalog_manager.cc:1259] Loaded cluster ID: f99ef0f1335342a282e0d1e5182c5c62
I20260810 03:49:04.541610 9038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:04.544198 9038 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:04.545039 9038 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Loaded TSK: 0
I20260810 03:49:04.545146 9038 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 925c3c57077349898f6d4cca6d8a6c61: Loaded TSK: 1
F20260810 03:49:04.546023 9038 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5bb29d69ad google::LogMessage::Fail() at ??:0
@ 0x7f5bb29d988a google::LogMessage::SendToLog() at ??:0
@ 0x7f5bb29d64de google::LogMessage::Flush() at ??:0
@ 0x7f5bb29d7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5bb569a18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f5bb5692f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f5bbd33f7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f5bbd31999c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f5bbd31a178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f5bbd35bdf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f5bbd37a82b std::function<>::operator()() at ??:0
@ 0x7f5bbd319b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f5bbd31af3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5bbd317579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f5bbd35b640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f5bb4c283d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5bb4c28c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f5bb4c2a3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f5bb4c19512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5bb625d6db start_thread at ??:0
@ 0x7f5bb14d461f clone at ??:0
W20260810 03:49:04.630640 9029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:04.631016 9029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:04.631101 9029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:04.637766 9029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:04.637841 9029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:04.637933 9029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:49:04.646973 9029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:46117
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=40355
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:04.648550 9029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:04.650064 9029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:04.662331 9084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:04.662349 9083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:04.662349 9086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:04.662892 9029 server_base.cc:1034] running on GCE node
I20260810 03:49:04.663383 9029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:04.664201 9029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:04.665400 9029 hybrid_clock.cc:648] HybridClock initialized: now 1786333744665375 us; error 32 us; skew 500 ppm
Aug 10 03:49:04 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333744, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:04.669021 9029 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:49:04.670250 9029 webserver.cc:460] Webserver started at http://127.22.134.193:40355/ using document root <none> and password file <none>
I20260810 03:49:04.671013 9029 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:04.671111 9029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:04.676369 9029 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:49:04.679384 9093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:04.681144 9029 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 03:49:04.681290 9029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "614be2b582ad42aa9c8cbc66c807d383"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "287bab882344566465dde06fb32ae512"
server_key_iv: "e6ec6f3dbfbb99d9174283c80c2f5205"
server_key_version: "encryptionkey@0"
I20260810 03:49:04.682044 9029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:04.707062 9029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:04.711272 9029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:04.711499 9029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:04.712304 9029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:04.713802 9101 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 03:49:04.718220 9029 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 03:49:04.718317 9029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260810 03:49:04.718393 9029 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 03:49:04.720750 9029 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 03:49:04.720820 9029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.001s
I20260810 03:49:04.721202 9101 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Bootstrap starting.
I20260810 03:49:04.732618 9029 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:46117
I20260810 03:49:04.733001 9218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:46117 every 8 connection(s)
I20260810 03:49:04.733932 9029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:49:04.734882 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 9029
I20260810 03:49:04.735383 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:40855
--local_ip_for_outbound_sockets=127.22.134.194
--tserver_master_addrs=127.22.134.254:42463
--webserver_port=37875
--webserver_interface=127.22.134.194
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:49:04.742461 9101 log.cc:824] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:04.753340 9101 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 03:49:04.753787 9101 tablet_bootstrap.cc:492] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Bootstrap complete.
I20260810 03:49:04.754962 9101 ts_tablet_manager.cc:1397] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Time spent bootstrapping tablet: real 0.034s user 0.025s sys 0.004s
I20260810 03:49:04.757500 9101 raft_consensus.cc:348] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:49:04.757962 9101 raft_consensus.cc:729] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614be2b582ad42aa9c8cbc66c807d383, State: Initialized, Role: FOLLOWER
I20260810 03:49:04.758476 9101 consensus_queue.cc:260] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:49:04.759387 9101 ts_tablet_manager.cc:1428] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
W20260810 03:49:04.829479 9221 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:49:04.736659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:44691)
0810 03:49:04.738050 (+ 1391us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:04.738113 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:04.739390 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:04.828573 (+ 89183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1151,"thread_start_us":156,"threads_started":1}
W20260810 03:49:04.830058 9219 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:42463 (0 consecutive failures): Network error: Failed to ping master at 127.22.134.254:42463: Client connection negotiation failed: client connection to 127.22.134.254:42463: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 03:49:04.830935 9221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:04.830653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:33185)
0810 03:49:04.830807 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:04.830875 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 03:49:04.831933 9221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:04.831587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:39387)
0810 03:49:04.831767 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:04.831859 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260810 03:49:04.832177 9219 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:49:04.867969 9222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:04.868258 9222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:04.868304 9222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:04.872541 9222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:04.872622 9222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:04.872721 9222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:49:04.878328 9222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:40855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=37875
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:04.879469 9222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:04.880556 9222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:49:04.890946 9222 server_base.cc:1034] running on GCE node
W20260810 03:49:04.890894 9229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:04.890900 9230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:04.890910 9232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:04.891687 9222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:04.892320 9222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:04.893486 9222 hybrid_clock.cc:648] HybridClock initialized: now 1786333744893471 us; error 28 us; skew 500 ppm
Aug 10 03:49:04 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333744, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:04.896310 9222 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:49:04.897356 9222 webserver.cc:460] Webserver started at http://127.22.134.194:37875/ using document root <none> and password file <none>
I20260810 03:49:04.897957 9222 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:04.898025 9222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:04.902014 9222 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:49:04.904223 9241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:04.905566 9222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:49:04.905718 9222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "e0eb88374aa74329bd96362c3c6c744a"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "bd5d777f7402b4ddd125f7156d35d603"
server_key_iv: "c3c590a4dae20364a5c11255de5995b2"
server_key_version: "encryptionkey@0"
I20260810 03:49:04.906276 9222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:04.925360 9222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:04.928643 9222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:04.928900 9222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:04.929571 9222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:04.930428 9222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:04.930498 9222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:04.930574 9222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:04.930652 9222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:04.940441 9222 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:40855
I20260810 03:49:04.940480 9372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:40855 every 8 connection(s)
I20260810 03:49:04.941504 9222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:49:04.946090 9375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:04.943973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:48805)
0810 03:49:04.944523 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:04.944647 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":138,"threads_started":1}
I20260810 03:49:04.946220 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 9222
W20260810 03:49:04.946579 9373 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:42463 (0 consecutive failures): Network error: Failed to ping master at 127.22.134.254:42463: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
I20260810 03:49:04.946715 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:40709
--local_ip_for_outbound_sockets=127.22.134.195
--tserver_master_addrs=127.22.134.254:42463
--webserver_port=43453
--webserver_interface=127.22.134.195
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:49:04.947412 9375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:04.947081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:55807)
0810 03:49:04.947248 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:04.947318 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 03:49:04.948127 9375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:04.947858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:46805)
0810 03:49:04.947986 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:04.948046 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 03:49:04.948383 9373 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 03:49:05.066401 9376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:05.066704 9376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:05.066784 9376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:05.070995 9376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:05.071070 9376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:05.071182 9376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:49:05.076635 9376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:40709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=43453
--tserver_master_addrs=127.22.134.254:42463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:05.077793 9376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:05.078943 9376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:05.089639 9387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:05.089654 9382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:05.089799 9376 server_base.cc:1034] running on GCE node
W20260810 03:49:05.089639 9385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:05.090626 9376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:05.091387 9376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:05.092622 9376 hybrid_clock.cc:648] HybridClock initialized: now 1786333745092580 us; error 55 us; skew 500 ppm
Aug 10 03:49:05 dist-test-slave-qg60 krb5kdc[7730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333745, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:05.095801 9376 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:49:05.096680 9376 webserver.cc:460] Webserver started at http://127.22.134.195:43453/ using document root <none> and password file <none>
I20260810 03:49:05.097316 9376 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:05.097383 9376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:05.101342 9376 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 03:49:05.103503 9396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:05.104981 9376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:49:05.105078 9376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "a37acfa41dd24ba9b74fe6217a93c7c5"
format_stamp: "Formatted at 2026-08-10 03:48:22 on dist-test-slave-qg60"
server_key: "e5724cfc5e476fe6c48be8c58b6034bf"
server_key_iv: "3a1531c8837760ab0aaf4359c1a5b20b"
server_key_version: "encryptionkey@0"
I20260810 03:49:05.105614 9376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:05.122151 9376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:05.125563 9376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:05.125741 9376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:05.126291 9376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:05.127146 9376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:05.127204 9376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:05.127245 9376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:05.127261 9376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:05.136477 9376 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:40709
I20260810 03:49:05.136552 9521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:40709 every 8 connection(s)
I20260810 03:49:05.137611 9376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:49:05.142196 9524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:05.139948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:37521)
0810 03:49:05.141290 (+ 1342us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:05.141414 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1115,"thread_start_us":887,"threads_started":1}
W20260810 03:49:05.142709 9522 heartbeater.cc:644] Failed to heartbeat to 127.22.134.254:42463 (0 consecutive failures): Network error: Failed to ping master at 127.22.134.254:42463: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
I20260810 03:49:05.143411 9524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:05.143155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:42933)
0810 03:49:05.143303 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:05.143355 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260810 03:49:05.144012 9524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:05.143823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:56517)
0810 03:49:05.143921 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:05.143963 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 03:49:05.144222 9522 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 03:49:05.145176 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 9376
I20260810 03:49:05.833550 9527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:05.832956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:37311)
0810 03:49:05.833359 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:05.833441 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":101,"threads_started":1}
I20260810 03:49:05.949635 9528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:05.949157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:52323)
0810 03:49:05.949457 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:05.949523 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":87,"threads_started":1}
I20260810 03:49:06.145522 9529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:06.144899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:42317)
0810 03:49:06.145350 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:06.145410 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":98,"threads_started":1}
I20260810 03:49:06.383637 9530 raft_consensus.cc:482] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:06.383898 9530 raft_consensus.cc:504] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:49:06.385363 9530 leader_election.cc:288] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855), a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
Aug 10 03:49:06 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333744, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.194@KRBTEST.COM
Aug 10 03:49:06 dist-test-slave-qg60 krb5kdc[7730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333744, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.195@KRBTEST.COM
I20260810 03:49:06.401118 9532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:06.385598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40855 (local address 127.22.134.193:36243)
0810 03:49:06.385960 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:06.385979 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:06.386121 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:06.388333 (+ 2212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:06.388346 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:06.388928 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:06.389521 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:06.389538 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:06.390945 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:06.390948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:06.391861 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:06.391870 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:06.392760 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:06.392767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:06.392848 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:06.393586 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:06.393605 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:06.395323 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:06.398229 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:06.398235 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:06.398257 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:06.398802 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:06.399297 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:06.399301 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:06.399303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:06.399410 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:06.400181 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:06.400184 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:06.400325 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 03:49:06.400516 (+ 191us) client_negotiation.cc:240] Negotiation successful
0810 03:49:06.400922 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":125,"spinlock_wait_cycles":15616,"thread_start_us":93,"threads_started":1}
I20260810 03:49:06.401139 9534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:06.385877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:32963 (local address 127.22.134.195:40709)
0810 03:49:06.386299 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:06.386328 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:06.386372 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:49:06.387135 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:06.387142 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:06.387537 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:06.387882 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:06.389742 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:06.390734 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:06.392024 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:06.392474 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:06.392595 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:06.396186 (+ 3591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:06.396198 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:06.396225 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:06.396262 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:06.398330 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:06.398962 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:06.398968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:06.398973 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:06.399129 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:06.399502 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:06.399505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:06.399507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:06.399931 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:06.400080 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:06.400639 (+ 559us) server_negotiation.cc:299] Negotiation successful
0810 03:49:06.400924 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":103,"threads_started":1}
I20260810 03:49:06.401153 9533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:06.385803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:36243 (local address 127.22.134.194:40855)
0810 03:49:06.386252 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:06.386276 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:06.386313 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:49:06.387135 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:06.387142 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:06.387535 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:06.387885 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:06.389718 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:06.390766 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:06.392113 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:06.392601 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:06.392802 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:06.395570 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:06.395575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:06.395588 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:06.395623 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:06.398073 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:06.398933 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:06.398940 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:06.398945 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:06.399115 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:06.399548 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:06.399551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:06.399552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:06.399930 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:06.400197 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:06.400634 (+ 437us) server_negotiation.cc:299] Negotiation successful
0810 03:49:06.400945 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":67,"threads_started":1}
I20260810 03:49:06.401180 9531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:06.385690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:40709 (local address 127.22.134.193:32963)
0810 03:49:06.386053 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:06.386068 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:06.386243 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:06.388360 (+ 2117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:06.388363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:06.388928 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:06.389551 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:06.389562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:06.390893 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:06.390897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:06.391861 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:06.391872 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:06.392608 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:06.392611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:06.392819 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:06.393586 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:06.393615 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:06.395950 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:06.398444 (+ 2494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:06.398448 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:06.398449 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:06.398828 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:06.399248 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:06.399251 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:06.399253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:06.399396 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:06.400059 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:06.400065 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:06.400326 (+ 261us) client_negotiation.cc:769] Sending connection context
0810 03:49:06.400524 (+ 198us) client_negotiation.cc:240] Negotiation successful
0810 03:49:06.401011 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":330,"spinlock_wait_cycles":96640,"thread_start_us":84,"threads_started":1}
W20260810 03:49:06.403776 9094 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
W20260810 03:49:06.403944 9097 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
I20260810 03:49:06.404021 9097 leader_election.cc:302] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 614be2b582ad42aa9c8cbc66c807d383; no voters: a37acfa41dd24ba9b74fe6217a93c7c5, e0eb88374aa74329bd96362c3c6c744a
I20260810 03:49:06.404260 9530 raft_consensus.cc:2726] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:49:06.834784 9531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:06.834470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:52267)
0810 03:49:06.834618 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:06.834692 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 03:49:06.951069 9536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:06.950586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:58269)
0810 03:49:06.950886 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:06.950961 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":92,"threads_started":1}
I20260810 03:49:07.146795 9537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:07.146357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:55159)
0810 03:49:07.146642 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:07.146699 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":78,"threads_started":1}
I20260810 03:49:07.836122 9538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:07.835617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:40727)
0810 03:49:07.835917 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:07.835977 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":90,"threads_started":1}
I20260810 03:49:07.952498 9539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:07.951984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:45395)
0810 03:49:07.952328 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:07.952396 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":146,"threads_started":1}
I20260810 03:49:08.148159 9541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:08.147689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:48277)
0810 03:49:08.147992 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:08.148057 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":99,"threads_started":1}
I20260810 03:49:08.421710 9542 raft_consensus.cc:482] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:08.421857 9542 raft_consensus.cc:504] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:49:08.422291 9542 leader_election.cc:288] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855), a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
W20260810 03:49:08.423280 9094 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
W20260810 03:49:08.423383 9097 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
I20260810 03:49:08.423499 9097 leader_election.cc:302] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 614be2b582ad42aa9c8cbc66c807d383; no voters: a37acfa41dd24ba9b74fe6217a93c7c5, e0eb88374aa74329bd96362c3c6c744a
I20260810 03:49:08.423684 9542 raft_consensus.cc:2726] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:49:08.837683 9543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:08.837167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:40641)
0810 03:49:08.837506 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:08.837581 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":91,"threads_started":1}
I20260810 03:49:08.954123 9544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:08.953647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:45107)
0810 03:49:08.953965 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:08.954025 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":106,"threads_started":1}
I20260810 03:49:09.149765 9545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:09.149254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:50973)
0810 03:49:09.149592 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:09.149662 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":101,"threads_started":1}
I20260810 03:49:09.839452 9546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:09.838846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:58419)
0810 03:49:09.839284 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:09.839352 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":115,"threads_started":1}
I20260810 03:49:09.955585 9547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:09.955085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:45873)
0810 03:49:09.955412 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:09.955483 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":99,"threads_started":1}
I20260810 03:49:10.151192 9548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:10.150724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:38323)
0810 03:49:10.151024 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:10.151091 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":88,"threads_started":1}
I20260810 03:49:10.841064 9549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:10.840448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:36341)
0810 03:49:10.840889 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:10.840960 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":100,"threads_started":1}
I20260810 03:49:10.957134 9550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:10.956538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:48857)
0810 03:49:10.956943 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:10.957017 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":93,"threads_started":1}
I20260810 03:49:11.106933 9551 raft_consensus.cc:482] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:11.107149 9551 raft_consensus.cc:504] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:49:11.107560 9551 leader_election.cc:288] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855), a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
W20260810 03:49:11.108438 9094 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
W20260810 03:49:11.108590 9097 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
I20260810 03:49:11.108675 9097 leader_election.cc:302] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 614be2b582ad42aa9c8cbc66c807d383; no voters: a37acfa41dd24ba9b74fe6217a93c7c5, e0eb88374aa74329bd96362c3c6c744a
I20260810 03:49:11.108873 9551 raft_consensus.cc:2726] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:49:11.152700 9552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:11.152226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:53201)
0810 03:49:11.152506 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:11.152600 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":86,"threads_started":1}
I20260810 03:49:11.842691 9553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:11.842157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:43679)
0810 03:49:11.842523 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:11.842589 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":105,"threads_started":1}
I20260810 03:49:11.958606 9554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:11.958032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:57615)
0810 03:49:11.958443 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:11.958508 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":96,"threads_started":1}
I20260810 03:49:12.154209 9555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:12.153681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:37433)
0810 03:49:12.154034 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:12.154101 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":92,"threads_started":1}
I20260810 03:49:12.844113 9556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:12.843626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:56487)
0810 03:49:12.843915 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:12.843982 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":83,"threads_started":1}
I20260810 03:49:12.959853 9557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:12.959374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:57233)
0810 03:49:12.959660 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:12.959747 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":85,"threads_started":1}
I20260810 03:49:13.046430 9558 raft_consensus.cc:482] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:13.046607 9558 raft_consensus.cc:504] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:49:13.047192 9558 leader_election.cc:288] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855), a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
W20260810 03:49:13.048152 9094 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
W20260810 03:49:13.048261 9097 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
I20260810 03:49:13.048370 9097 leader_election.cc:302] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 614be2b582ad42aa9c8cbc66c807d383; no voters: a37acfa41dd24ba9b74fe6217a93c7c5, e0eb88374aa74329bd96362c3c6c744a
I20260810 03:49:13.048552 9558 raft_consensus.cc:2726] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:49:13.155772 9559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:13.155301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:34067)
0810 03:49:13.155595 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:13.155666 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":83,"threads_started":1}
I20260810 03:49:13.845789 9561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:13.845246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:34347)
0810 03:49:13.845613 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:13.845686 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":119,"threads_started":1}
I20260810 03:49:13.961349 9562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:13.960862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:50997)
0810 03:49:13.961181 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:13.961246 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":78,"threads_started":1}
I20260810 03:49:14.157284 9563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:14.156695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:58917)
0810 03:49:14.157047 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:14.157156 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":91,"threads_started":1}
I20260810 03:49:14.760023 9564 raft_consensus.cc:482] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:14.760169 9564 raft_consensus.cc:504] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0eb88374aa74329bd96362c3c6c744a" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40855 } } peers { permanent_uuid: "a37acfa41dd24ba9b74fe6217a93c7c5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 40709 } } peers { permanent_uuid: "614be2b582ad42aa9c8cbc66c807d383" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46117 } }
I20260810 03:49:14.760819 9564 leader_election.cc:288] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855), a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709)
W20260810 03:49:14.762130 9094 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a37acfa41dd24ba9b74fe6217a93c7c5 (127.22.134.195:40709): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
W20260810 03:49:14.762280 9097 leader_election.cc:341] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e0eb88374aa74329bd96362c3c6c744a (127.22.134.194:40855): Not found: Tablet not found: 6aa989a042bd4a02bfdc273c8fc3adfe
I20260810 03:49:14.762351 9097 leader_election.cc:302] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 614be2b582ad42aa9c8cbc66c807d383; no voters: a37acfa41dd24ba9b74fe6217a93c7c5, e0eb88374aa74329bd96362c3c6c744a
I20260810 03:49:14.762492 9564 raft_consensus.cc:2726] T 6aa989a042bd4a02bfdc273c8fc3adfe P 614be2b582ad42aa9c8cbc66c807d383 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 03:49:14.847474 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:14.847016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:46765)
0810 03:49:14.847309 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:14.847375 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":92,"threads_started":1}
I20260810 03:49:14.962682 9566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:14.962216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:38611)
0810 03:49:14.962516 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:14.962581 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":96,"threads_started":1}
I20260810 03:49:15.158880 9567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:15.158377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:44605)
0810 03:49:15.158709 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:15.158777 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":106,"threads_started":1}
I20260810 03:49:15.849009 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:15.848408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:46991)
0810 03:49:15.848824 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:15.848891 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":95,"threads_started":1}
I20260810 03:49:15.964082 9569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:15.963593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:46225)
0810 03:49:15.963851 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:15.963911 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":75,"threads_started":1}
I20260810 03:49:16.160422 9570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:16.159907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:51797)
0810 03:49:16.160253 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:16.160322 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":81,"threads_started":1}
I20260810 03:49:16.850435 9571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:16.849930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:47609)
0810 03:49:16.850261 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:16.850331 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":89,"threads_started":1}
I20260810 03:49:16.965479 9573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:16.964976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:40157)
0810 03:49:16.965249 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:16.965327 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":79,"threads_started":1}
I20260810 03:49:17.162050 9574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:17.161518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:54661)
0810 03:49:17.161870 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:17.161941 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":94,"threads_started":1}
I20260810 03:49:17.851893 9575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:17.851479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:41367)
0810 03:49:17.851741 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:17.851797 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":82,"threads_started":1}
I20260810 03:49:17.966828 9576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:17.966361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:46063)
0810 03:49:17.966657 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:17.966725 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":101,"threads_started":1}
I20260810 03:49:18.163435 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:18.162932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:32775)
0810 03:49:18.163266 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:18.163332 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":81,"threads_started":1}
I20260810 03:49:18.853389 9578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:18.852919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:52227)
0810 03:49:18.853221 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:18.853288 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":90,"threads_started":1}
I20260810 03:49:18.968330 9579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:18.967815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:59413)
0810 03:49:18.968155 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:18.968224 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":85,"threads_started":1}
I20260810 03:49:19.165108 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:19.164480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:55271)
0810 03:49:19.164881 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:19.164946 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":132,"threads_started":1}
I20260810 03:49:19.855039 9582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:19.854565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.193:48583)
0810 03:49:19.854878 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:19.854943 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":106,"threads_started":1}
I20260810 03:49:19.970034 9583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:19.969520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.194:58889)
0810 03:49:19.969845 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:19.969917 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":115,"threads_started":1}
I20260810 03:49:20.149624 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 9029
I20260810 03:49:20.159322 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 9222
I20260810 03:49:20.166635 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:20.166051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:42463 (local address 127.22.134.195:41179)
0810 03:49:20.166392 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:20.166482 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.254:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":82,"threads_started":1}
I20260810 03:49:20.168524 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 9376
2026-08-10T03:49:20Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59832 ms)
[----------] 30 tests from SecurityITest (258079 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:20 dist-test-slave-qg60 krb5kdc[9588](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:20 dist-test-slave-qg60 krb5kdc[9588](info): set up 2 sockets
Aug 10 03:49:20 dist-test-slave-qg60 krb5kdc[9588](info): commencing operation
krb5kdc: starting...
W20260810 03:49:21.305979 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:21 dist-test-slave-qg60 krb5kdc[9588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:21.444554 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:46373
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:46373
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:21.567189 9601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:21.567632 9601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:21.567773 9601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:21.572135 9601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:21.572208 9601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:21.572229 9601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:21.572247 9601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:21.572290 9601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:21.577960 9601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:46373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:46373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:21.579149 9601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:21.580232 9601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:21.589169 9606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:21.589244 9601 server_base.cc:1034] running on GCE node
W20260810 03:49:21.589243 9607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:21.589169 9609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:21.590086 9601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:21.591317 9601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:21.592832 9601 hybrid_clock.cc:648] HybridClock initialized: now 1786333761592796 us; error 48 us; skew 500 ppm
Aug 10 03:49:21 dist-test-slave-qg60 krb5kdc[9588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333761, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:21.601420 9601 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:21.602705 9601 webserver.cc:460] Webserver started at http://127.22.134.254:37501/ using document root <none> and password file <none>
I20260810 03:49:21.603368 9601 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:21.603472 9601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:21.603744 9601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:21.606521 9601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "652108f04a7a46f1aa07aff678dd9ccb"
format_stamp: "Formatted at 2026-08-10 03:49:21 on dist-test-slave-qg60"
server_key: "aeb772b3d76cc741536efe81696dd92a"
server_key_iv: "56adf19981ad51536a9a265188fec4cc"
server_key_version: "encryptionkey@0"
I20260810 03:49:21.607182 9601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "652108f04a7a46f1aa07aff678dd9ccb"
format_stamp: "Formatted at 2026-08-10 03:49:21 on dist-test-slave-qg60"
server_key: "aeb772b3d76cc741536efe81696dd92a"
server_key_iv: "56adf19981ad51536a9a265188fec4cc"
server_key_version: "encryptionkey@0"
I20260810 03:49:21.611240 9601 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 03:49:21.614245 9618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:21.615643 9601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:49:21.615808 9601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "652108f04a7a46f1aa07aff678dd9ccb"
format_stamp: "Formatted at 2026-08-10 03:49:21 on dist-test-slave-qg60"
server_key: "aeb772b3d76cc741536efe81696dd92a"
server_key_iv: "56adf19981ad51536a9a265188fec4cc"
server_key_version: "encryptionkey@0"
I20260810 03:49:21.615939 9601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:21.636462 9601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:21.640408 9601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:21.640648 9601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:21.649159 9601 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:46373
I20260810 03:49:21.649250 9677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:46373 every 8 connection(s)
I20260810 03:49:21.650295 9601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:21.653115 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 9601
I20260810 03:49:21.653286 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:21.653455 9678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:21.653636 23067 external_mini_cluster.cc:1428] Setting key 849d5899fd46ed6b7944d4ab4347f300
I20260810 03:49:21.660032 9678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb: Bootstrap starting.
Aug 10 03:49:21 dist-test-slave-qg60 krb5kdc[9588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:21.662693 9678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:21.663604 9678 log.cc:824] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:21.666378 9678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb: No bootstrap required, opened a new log
I20260810 03:49:21.668634 9681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:21.654974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58556 (local address 127.22.134.254:46373)
0810 03:49:21.655421 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:21.655436 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:21.655472 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:49:21.656215 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:21.656233 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:21.656566 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:21.656938 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:21.657731 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:21.658718 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:21.659580 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:21.660044 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:21.660214 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:21.663070 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:21.663077 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:21.663094 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:21.663127 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:21.665341 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:21.665853 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:21.665859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:21.665865 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:21.666012 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:21.666292 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:21.666295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:21.666297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:21.666836 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:21.667026 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:21.667305 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 03:49:21.667625 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":155,"threads_started":1}
I20260810 03:49:21.670939 9678 raft_consensus.cc:348] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652108f04a7a46f1aa07aff678dd9ccb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46373 } }
I20260810 03:49:21.671238 9678 raft_consensus.cc:374] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:21.671311 9678 raft_consensus.cc:729] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 652108f04a7a46f1aa07aff678dd9ccb, State: Initialized, Role: FOLLOWER
I20260810 03:49:21.671713 9678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652108f04a7a46f1aa07aff678dd9ccb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46373 } }
I20260810 03:49:21.671833 9678 raft_consensus.cc:388] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:21.671916 9678 raft_consensus.cc:482] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:21.672008 9678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:21.673040 9678 raft_consensus.cc:504] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652108f04a7a46f1aa07aff678dd9ccb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46373 } }
I20260810 03:49:21.673405 9678 leader_election.cc:302] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 652108f04a7a46f1aa07aff678dd9ccb; no voters:
I20260810 03:49:21.673738 9678 leader_election.cc:288] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:21.673941 9683 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:21.674247 9683 raft_consensus.cc:686] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [term 1 LEADER]: Becoming Leader. State: Replica: 652108f04a7a46f1aa07aff678dd9ccb, State: Running, Role: LEADER
I20260810 03:49:21.674583 9683 consensus_queue.cc:237] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652108f04a7a46f1aa07aff678dd9ccb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46373 } }
I20260810 03:49:21.674999 9678 sys_catalog.cc:564] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:21.676280 9684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "652108f04a7a46f1aa07aff678dd9ccb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652108f04a7a46f1aa07aff678dd9ccb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46373 } } }
I20260810 03:49:21.676405 9684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:21.676636 9685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 652108f04a7a46f1aa07aff678dd9ccb. Latest consensus state: current_term: 1 leader_uuid: "652108f04a7a46f1aa07aff678dd9ccb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652108f04a7a46f1aa07aff678dd9ccb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 46373 } } }
I20260810 03:49:21.676811 9685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:21.677165 9693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:21.680539 9693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:21.686975 9693 catalog_manager.cc:1347] Generated new cluster ID: 220e5f7742964006b652355715b63e67
I20260810 03:49:21.687158 9693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:21.712783 9693 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:21.714138 9693 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:21.720777 9693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb: Generated new TSK 0
I20260810 03:49:21.721588 9693 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:49:21.760861 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:46373
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:21.887777 9705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:21.888152 9705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:21.888201 9705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:21.892302 9705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:21.892366 9705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:21.892467 9705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:49:21.897987 9705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:21.899158 9705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:21.900199 9705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:21.910594 9710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:21.910754 9705 server_base.cc:1034] running on GCE node
W20260810 03:49:21.910668 9712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:21.910629 9714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:21.911231 9705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:21.911960 9705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:21.913136 9705 hybrid_clock.cc:648] HybridClock initialized: now 1786333761913116 us; error 36 us; skew 500 ppm
Aug 10 03:49:21 dist-test-slave-qg60 krb5kdc[9588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333761, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:21.916134 9705 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:49:21.917086 9705 webserver.cc:460] Webserver started at http://127.22.134.193:42105/ using document root <none> and password file <none>
I20260810 03:49:21.917637 9705 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:21.917699 9705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:21.917869 9705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:21.919977 9705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "d9c5111f0fb7471e977b2ff1d209a353"
format_stamp: "Formatted at 2026-08-10 03:49:21 on dist-test-slave-qg60"
server_key: "cd3ec4d97e76872e5179139d34f4786a"
server_key_iv: "dfed4598c1aec1fcbd939e15f4348560"
server_key_version: "encryptionkey@0"
I20260810 03:49:21.920545 9705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "d9c5111f0fb7471e977b2ff1d209a353"
format_stamp: "Formatted at 2026-08-10 03:49:21 on dist-test-slave-qg60"
server_key: "cd3ec4d97e76872e5179139d34f4786a"
server_key_iv: "dfed4598c1aec1fcbd939e15f4348560"
server_key_version: "encryptionkey@0"
I20260810 03:49:21.924389 9705 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260810 03:49:21.927135 9722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:21.928558 9705 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 03:49:21.928694 9705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "d9c5111f0fb7471e977b2ff1d209a353"
format_stamp: "Formatted at 2026-08-10 03:49:21 on dist-test-slave-qg60"
server_key: "cd3ec4d97e76872e5179139d34f4786a"
server_key_iv: "dfed4598c1aec1fcbd939e15f4348560"
server_key_version: "encryptionkey@0"
I20260810 03:49:21.928879 9705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:21.979714 9705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:21.983009 9705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:21.983229 9705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:21.983875 9705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:21.984763 9705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:21.984812 9705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:21.984876 9705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:21.984907 9705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:21.994472 9705 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:35085
I20260810 03:49:21.994510 9848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:35085 every 8 connection(s)
I20260810 03:49:21.995464 9705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:49:22.000252 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 9705
I20260810 03:49:22.000417 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:49:22.000818 23067 external_mini_cluster.cc:1428] Setting key e714eef3545cad047b5339b71ede5240
Aug 10 03:49:22 dist-test-slave-qg60 krb5kdc[9588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333761, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:22.011353 9681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:21.997425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:47653 (local address 127.22.134.254:46373)
0810 03:49:21.997579 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:21.997583 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:21.998474 (+ 891us) server_negotiation.cc:407] Connection header received
0810 03:49:21.999904 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:21.999907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:21.999957 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.000039 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:22.001720 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.002374 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.003644 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.003885 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.003997 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.007069 (+ 3072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:22.007072 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:22.007074 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:22.007101 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:22.008886 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:22.009522 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:22.009529 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:22.009531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:22.009631 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:22.010020 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:22.010025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:22.010027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:22.010268 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:22.010389 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.010976 (+ 587us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.011145 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:49:22.012275 9851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:21.997787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:46373 (local address 127.22.134.193:47653)
0810 03:49:21.998306 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:21.998353 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:21.999692 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:22.000263 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:22.000276 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:22.000856 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:22.001549 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.001566 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.002507 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.002515 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.003498 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.003509 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.004046 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.004051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.004233 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.004920 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:22.004937 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:22.006833 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:22.009020 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:22.009026 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:22.009047 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:22.009402 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:22.009736 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:22.009740 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:22.009742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:22.009910 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:22.010387 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:22.010395 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:22.010710 (+ 315us) client_negotiation.cc:769] Sending connection context
0810 03:49:22.010929 (+ 219us) client_negotiation.cc:240] Negotiation successful
0810 03:49:22.011308 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":128,"threads_started":1}
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:49:22.013870 9849 heartbeater.cc:347] Connected to a master server at 127.22.134.254:46373
I20260810 03:49:22.014182 9849 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:22.014707 9849 heartbeater.cc:511] Master 127.22.134.254:46373 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:49:22.016536 9638 ts_manager.cc:194] Registered new tserver with Master: d9c5111f0fb7471e977b2ff1d209a353 (127.22.134.193:35085)
I20260810 03:49:22.017958 9638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:47653
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:49:22.034181 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:46373
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:22.150419 9854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:22.150771 9854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:22.150861 9854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:22.154937 9854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:22.155035 9854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:22.155126 9854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:49:22.160581 9854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:22.161780 9854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:22.162921 9854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:22.173475 9862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:22.173506 9860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:22.173501 9859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:22.173629 9854 server_base.cc:1034] running on GCE node
I20260810 03:49:22.174247 9854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:22.174963 9854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:22.176162 9854 hybrid_clock.cc:648] HybridClock initialized: now 1786333762176143 us; error 33 us; skew 500 ppm
Aug 10 03:49:22 dist-test-slave-qg60 krb5kdc[9588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333762, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:22.179279 9854 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:49:22.180193 9854 webserver.cc:460] Webserver started at http://127.22.134.194:35935/ using document root <none> and password file <none>
I20260810 03:49:22.180810 9854 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:22.180876 9854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:22.181061 9854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:22.183184 9854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "cb0bd52eab004f46adbe02473a4d1437"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "c435d64c862e8f32d68c76e7c6de0128"
server_key_iv: "cf8431413957212c83570e84f5e2e7ee"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.183707 9854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "cb0bd52eab004f46adbe02473a4d1437"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "c435d64c862e8f32d68c76e7c6de0128"
server_key_iv: "cf8431413957212c83570e84f5e2e7ee"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.187707 9854 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:49:22.190500 9869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:22.191978 9854 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:49:22.192090 9854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "cb0bd52eab004f46adbe02473a4d1437"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "c435d64c862e8f32d68c76e7c6de0128"
server_key_iv: "cf8431413957212c83570e84f5e2e7ee"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.192189 9854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:22.202633 9854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:22.205876 9854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:22.206046 9854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:22.206588 9854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:22.207379 9854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:22.207427 9854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:22.207468 9854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:22.207486 9854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:22.217198 9854 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:40183
I20260810 03:49:22.217226 9997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:40183 every 8 connection(s)
I20260810 03:49:22.218107 9854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:49:22.222237 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 9854
I20260810 03:49:22.222384 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:49:22.222714 23067 external_mini_cluster.cc:1428] Setting key ee1ffc66ac04a518fca65ccdecf42b02
Aug 10 03:49:22 dist-test-slave-qg60 krb5kdc[9588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333762, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:22.235401 9681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.220021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:43539 (local address 127.22.134.254:46373)
0810 03:49:22.220185 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.220190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.221240 (+ 1050us) server_negotiation.cc:407] Connection header received
0810 03:49:22.223230 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.223233 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.223298 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.223380 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:22.225113 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.225643 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.227275 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.227667 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.227802 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.230952 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:22.230959 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:22.230967 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:22.231007 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:22.232981 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:22.233606 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:22.233611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:22.233615 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:22.233728 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:22.234098 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:22.234102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:22.234104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:22.234380 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:22.234509 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.235044 (+ 535us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.235206 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:49:22.236145 10000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.220473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:46373 (local address 127.22.134.194:43539)
0810 03:49:22.221041 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.221118 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:22.222942 (+ 1824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:22.223613 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:22.223621 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:22.224101 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:22.224914 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.224940 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.225774 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.225781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.227137 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.227148 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.227824 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.227827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.227984 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.228685 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:22.228702 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:22.230762 (+ 2060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:22.233146 (+ 2384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:22.233151 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:22.233165 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:22.233455 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:22.233832 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:22.233834 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:22.233835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:22.233974 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:22.234493 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:22.234498 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:22.234752 (+ 254us) client_negotiation.cc:769] Sending connection context
0810 03:49:22.234908 (+ 156us) client_negotiation.cc:240] Negotiation successful
0810 03:49:22.235193 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":112,"threads_started":1}
I20260810 03:49:22.237483 9998 heartbeater.cc:347] Connected to a master server at 127.22.134.254:46373
I20260810 03:49:22.237742 9998 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:22.238327 9998 heartbeater.cc:511] Master 127.22.134.254:46373 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
I20260810 03:49:22.239531 9638 ts_manager.cc:194] Registered new tserver with Master: cb0bd52eab004f46adbe02473a4d1437 (127.22.134.194:40183)
I20260810 03:49:22.240140 9638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:43539
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:49:22.256158 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:46373
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:43343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:22.371526 10003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:22.371797 10003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:22.371842 10003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:22.376669 10003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:22.376766 10003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:22.376832 10003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:49:22.382541 10003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:43343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:46373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:22.383683 10003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:22.384671 10003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:22.394790 10011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:22.394793 10008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:22.394793 10009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:22.395292 10003 server_base.cc:1034] running on GCE node
I20260810 03:49:22.395777 10003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:22.396458 10003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:22.397655 10003 hybrid_clock.cc:648] HybridClock initialized: now 1786333762397642 us; error 61 us; skew 500 ppm
Aug 10 03:49:22 dist-test-slave-qg60 krb5kdc[9588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333762, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:22.400583 10003 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:49:22.401595 10003 webserver.cc:460] Webserver started at http://127.22.134.195:37291/ using document root <none> and password file <none>
I20260810 03:49:22.402145 10003 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:22.402206 10003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:22.402379 10003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:22.405043 10003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "41451b4ec7a94da7a879e855e935f433"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "46ee28ee5b20d82aef21f7a83e5c69b4"
server_key_iv: "eb66d134b9ceff5fd5561509301eee39"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.405854 10003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "41451b4ec7a94da7a879e855e935f433"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "46ee28ee5b20d82aef21f7a83e5c69b4"
server_key_iv: "eb66d134b9ceff5fd5561509301eee39"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.410106 10003 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:22.412670 10021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:22.414083 10003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:49:22.414237 10003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "41451b4ec7a94da7a879e855e935f433"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "46ee28ee5b20d82aef21f7a83e5c69b4"
server_key_iv: "eb66d134b9ceff5fd5561509301eee39"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.414363 10003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:22.436046 10003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:22.439340 10003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:22.439555 10003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:22.440158 10003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:22.441085 10003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:22.441151 10003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:22.441219 10003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:22.441264 10003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:22.451352 10003 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:46045
I20260810 03:49:22.451433 10141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:46045 every 8 connection(s)
I20260810 03:49:22.452327 10003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:49:22.454182 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 10003
I20260810 03:49:22.454321 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:49:22.454682 23067 external_mini_cluster.cc:1428] Setting key 6cc402c4710af200c50bdd821476439e
Aug 10 03:49:22 dist-test-slave-qg60 krb5kdc[9588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333762, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:22.466634 9681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.454452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:44767 (local address 127.22.134.254:46373)
0810 03:49:22.454634 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.454640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.455354 (+ 714us) server_negotiation.cc:407] Connection header received
0810 03:49:22.456775 (+ 1421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.456778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.456834 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.456935 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:22.458178 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.458714 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.459853 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.460077 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.460186 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.462831 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:22.462834 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:22.462842 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:22.462867 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:22.464318 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:22.464921 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:22.464928 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:22.464931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:22.465018 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:22.465451 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:22.465455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:22.465457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:22.465667 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:22.465774 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.466296 (+ 522us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.466448 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 03:49:22.467458 10145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.454736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:46373 (local address 127.22.134.195:44767)
0810 03:49:22.455203 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.455256 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:22.456540 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:22.457122 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:22.457129 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:22.457481 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:22.458035 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.458048 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.458845 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.458848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.459725 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.459734 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.460235 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.460239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.460400 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.461115 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:22.461131 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:22.462654 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:22.464462 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:22.464468 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:22.464484 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:22.464821 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:22.465173 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:22.465176 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:22.465178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:22.465349 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:22.465773 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:22.465780 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:22.466054 (+ 274us) client_negotiation.cc:769] Sending connection context
0810 03:49:22.466254 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 03:49:22.466596 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":126,"threads_started":1}
I20260810 03:49:22.468688 10142 heartbeater.cc:347] Connected to a master server at 127.22.134.254:46373
I20260810 03:49:22.468994 10142 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:22.469566 10142 heartbeater.cc:511] Master 127.22.134.254:46373 requested a full tablet report, sending...
I20260810 03:49:22.470659 9637 ts_manager.cc:194] Registered new tserver with Master: 41451b4ec7a94da7a879e855e935f433 (127.22.134.195:46045)
I20260810 03:49:22.471314 9637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:44767
I20260810 03:49:22.480939 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:49:22.491185 9681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.483144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58570 (local address 127.22.134.254:46373)
0810 03:49:22.483315 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.483318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.483438 (+ 120us) server_negotiation.cc:407] Connection header received
0810 03:49:22.483586 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.483589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.483637 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.483712 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:22.484469 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.485069 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.485991 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.486207 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.486298 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.487763 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:22.487766 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:22.487768 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:22.487791 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:22.489327 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:22.489768 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:22.489770 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:22.489771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:22.489846 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:22.490093 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:22.490096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:22.490097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:22.490316 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:22.490419 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.490897 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.491059 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:49:22.494647 9637 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:49:22.498194 9637 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:49:22.513285 10157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.507669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44096 (local address 127.22.134.193:35085)
0810 03:49:22.508605 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.508621 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.508646 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:49:22.508760 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.508767 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.509013 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.509192 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:22.509493 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.510428 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.511917 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.512507 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.512639 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.512811 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.513018 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.513119 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":822,"thread_start_us":72,"threads_started":1}
I20260810 03:49:22.513276 10158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.507507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:35085 (local address 127.0.0.1:44096)
0810 03:49:22.508097 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.508148 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:22.508285 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:22.509181 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:22.509187 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:22.509211 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:22.509360 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.509367 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.510569 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.510576 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.511795 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.511804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.512638 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.512642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.512797 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.512845 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 03:49:22.512987 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 03:49:22.513120 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":91,"threads_started":1}
I20260810 03:49:22.513926 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.507668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40183 (local address 127.0.0.1:33042)
0810 03:49:22.508568 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.508581 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:22.508848 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:22.509644 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:22.509647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:22.509681 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:22.509820 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.509832 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.511430 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.511433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.512301 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.512312 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.513514 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.513517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.513620 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.513646 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 03:49:22.513693 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 03:49:22.513779 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":30,"spinlock_wait_cycles":1280,"thread_start_us":128,"threads_started":1}
I20260810 03:49:22.514705 10159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.508132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33042 (local address 127.22.134.194:40183)
0810 03:49:22.509229 (+ 1097us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.509239 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.509257 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:49:22.509321 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.509325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.509488 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.510047 (+ 559us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:22.510225 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.511291 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.512431 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.513375 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.514264 (+ 889us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.514395 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.514457 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.514548 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":999,"thread_start_us":124,"threads_started":1}
I20260810 03:49:22.515410 10160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.508227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:46045 (local address 127.0.0.1:44400)
0810 03:49:22.508879 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.508894 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:22.509000 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:22.509610 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:22.509613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:22.509632 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:22.509779 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.509785 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.511422 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.511425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.513693 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.513702 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.515003 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.515007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.515092 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.515125 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:49:22.515210 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 03:49:22.515281 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":81,"spinlock_wait_cycles":2304,"thread_start_us":100,"threads_started":1}
I20260810 03:49:22.515502 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.508678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44400 (local address 127.22.134.195:46045)
0810 03:49:22.509147 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.509159 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.509182 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:49:22.509258 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.509262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.509451 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.509631 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:22.509908 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.511259 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.513826 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.514667 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.514808 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.514932 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.515261 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.515366 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":186,"threads_started":1}
I20260810 03:49:22.516845 9778 tablet_service.cc:1467] Processing CreateTablet for tablet cfdb58f78f254307b690f3bc3392c480 (DEFAULT_TABLE table=test-table [id=88cfb9f6811a43a89315f8a1f6bbe5c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:22.517976 9778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfdb58f78f254307b690f3bc3392c480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:22.517752 9926 tablet_service.cc:1467] Processing CreateTablet for tablet cfdb58f78f254307b690f3bc3392c480 (DEFAULT_TABLE table=test-table [id=88cfb9f6811a43a89315f8a1f6bbe5c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:22.518864 9926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfdb58f78f254307b690f3bc3392c480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:22.518559 10073 tablet_service.cc:1467] Processing CreateTablet for tablet cfdb58f78f254307b690f3bc3392c480 (DEFAULT_TABLE table=test-table [id=88cfb9f6811a43a89315f8a1f6bbe5c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:22.519527 10073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfdb58f78f254307b690f3bc3392c480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:22.525014 10163 tablet_bootstrap.cc:492] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353: Bootstrap starting.
I20260810 03:49:22.526859 10165 tablet_bootstrap.cc:492] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: Bootstrap starting.
I20260810 03:49:22.526859 10164 tablet_bootstrap.cc:492] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437: Bootstrap starting.
I20260810 03:49:22.527482 10163 tablet_bootstrap.cc:654] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:22.528235 10163 log.cc:824] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:22.529143 10164 tablet_bootstrap.cc:654] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:22.529143 10165 tablet_bootstrap.cc:654] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:22.530391 10163 tablet_bootstrap.cc:492] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353: No bootstrap required, opened a new log
I20260810 03:49:22.530536 10164 log.cc:824] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:22.530536 10165 log.cc:824] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:22.530614 10163 ts_tablet_manager.cc:1397] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:49:22.532614 10165 tablet_bootstrap.cc:492] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: No bootstrap required, opened a new log
I20260810 03:49:22.532615 10164 tablet_bootstrap.cc:492] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437: No bootstrap required, opened a new log
I20260810 03:49:22.532843 10164 ts_tablet_manager.cc:1397] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260810 03:49:22.532843 10165 ts_tablet_manager.cc:1397] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260810 03:49:22.534562 10163 raft_consensus.cc:348] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.534825 10163 raft_consensus.cc:374] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:22.534899 10163 raft_consensus.cc:729] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9c5111f0fb7471e977b2ff1d209a353, State: Initialized, Role: FOLLOWER
I20260810 03:49:22.535355 10163 consensus_queue.cc:260] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.536403 10163 ts_tablet_manager.cc:1428] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:49:22.536790 10165 raft_consensus.cc:348] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.536810 10164 raft_consensus.cc:348] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.537060 10164 raft_consensus.cc:374] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:22.537120 10164 raft_consensus.cc:729] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0bd52eab004f46adbe02473a4d1437, State: Initialized, Role: FOLLOWER
I20260810 03:49:22.537143 10165 raft_consensus.cc:374] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:22.537166 9849 heartbeater.cc:503] Master 127.22.134.254:46373 was elected leader, sending a full tablet report...
I20260810 03:49:22.537209 10165 raft_consensus.cc:729] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41451b4ec7a94da7a879e855e935f433, State: Initialized, Role: FOLLOWER
I20260810 03:49:22.537618 10164 consensus_queue.cc:260] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.537618 10165 consensus_queue.cc:260] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.538280 9998 heartbeater.cc:503] Master 127.22.134.254:46373 was elected leader, sending a full tablet report...
I20260810 03:49:22.538558 10142 heartbeater.cc:503] Master 127.22.134.254:46373 was elected leader, sending a full tablet report...
I20260810 03:49:22.538582 10165 ts_tablet_manager.cc:1428] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260810 03:49:22.539074 10164 ts_tablet_manager.cc:1428] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:49:22.626291 10172 raft_consensus.cc:482] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:22.626581 10172 raft_consensus.cc:504] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.627822 10172 leader_election.cc:288] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9c5111f0fb7471e977b2ff1d209a353 (127.22.134.193:35085), cb0bd52eab004f46adbe02473a4d1437 (127.22.134.194:40183)
I20260810 03:49:22.633208 10157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.628285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:48189 (local address 127.22.134.193:35085)
0810 03:49:22.628426 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.628433 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.628450 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:49:22.628518 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.628521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.628575 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.628650 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:22.629108 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.630031 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.631817 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.632433 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.632603 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.632661 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.632977 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.633066 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:49:22.633224 10159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.628537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:40249 (local address 127.22.134.194:40183)
0810 03:49:22.628673 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.628677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.628690 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:49:22.628870 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.628873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.628936 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.629083 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:22.629493 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.630268 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.631817 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.632515 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.632620 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.632661 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.632979 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.633123 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:49:22.633286 10174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.628174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40183 (local address 127.22.134.195:40249)
0810 03:49:22.628618 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.628632 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:22.628752 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:22.629134 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:22.629140 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:22.629162 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:22.629300 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.629322 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.630381 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.630384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.631639 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.631650 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.632614 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.632617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.632789 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.632862 (+ 73us) client_negotiation.cc:769] Sending connection context
0810 03:49:22.632938 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 03:49:22.633097 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":186,"thread_start_us":146,"threads_started":1}
I20260810 03:49:22.633330 10145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.628046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:35085 (local address 127.22.134.195:48189)
0810 03:49:22.628211 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.628231 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:22.628331 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:22.628781 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:22.628784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:22.628825 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:22.628951 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.628973 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.630197 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.630200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.631639 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:22.631650 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.632603 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.632606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:22.632784 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.632859 (+ 75us) client_negotiation.cc:769] Sending connection context
0810 03:49:22.632942 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 03:49:22.633094 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":96}
I20260810 03:49:22.634100 9949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfdb58f78f254307b690f3bc3392c480" candidate_uuid: "41451b4ec7a94da7a879e855e935f433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0bd52eab004f46adbe02473a4d1437" is_pre_election: true
I20260810 03:49:22.634102 9799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfdb58f78f254307b690f3bc3392c480" candidate_uuid: "41451b4ec7a94da7a879e855e935f433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9c5111f0fb7471e977b2ff1d209a353" is_pre_election: true
I20260810 03:49:22.634447 9949 raft_consensus.cc:2454] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41451b4ec7a94da7a879e855e935f433 in term 0.
I20260810 03:49:22.634447 9799 raft_consensus.cc:2454] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41451b4ec7a94da7a879e855e935f433 in term 0.
I20260810 03:49:22.635025 10024 leader_election.cc:302] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 41451b4ec7a94da7a879e855e935f433, cb0bd52eab004f46adbe02473a4d1437, d9c5111f0fb7471e977b2ff1d209a353; no voters:
I20260810 03:49:22.635377 10172 raft_consensus.cc:2781] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:49:22.635483 10172 raft_consensus.cc:482] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:49:22.635568 10172 raft_consensus.cc:3037] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:22.636669 10172 raft_consensus.cc:504] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.637120 10172 leader_election.cc:288] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [CANDIDATE]: Term 1 election: Requested vote from peers d9c5111f0fb7471e977b2ff1d209a353 (127.22.134.193:35085), cb0bd52eab004f46adbe02473a4d1437 (127.22.134.194:40183)
I20260810 03:49:22.637526 9949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfdb58f78f254307b690f3bc3392c480" candidate_uuid: "41451b4ec7a94da7a879e855e935f433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0bd52eab004f46adbe02473a4d1437"
I20260810 03:49:22.637553 9799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfdb58f78f254307b690f3bc3392c480" candidate_uuid: "41451b4ec7a94da7a879e855e935f433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9c5111f0fb7471e977b2ff1d209a353"
I20260810 03:49:22.637642 9949 raft_consensus.cc:3037] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:22.637694 9799 raft_consensus.cc:3037] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:22.638764 9799 raft_consensus.cc:2454] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41451b4ec7a94da7a879e855e935f433 in term 1.
I20260810 03:49:22.638826 9949 raft_consensus.cc:2454] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41451b4ec7a94da7a879e855e935f433 in term 1.
I20260810 03:49:22.639191 10025 leader_election.cc:302] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41451b4ec7a94da7a879e855e935f433, cb0bd52eab004f46adbe02473a4d1437; no voters:
I20260810 03:49:22.639395 10172 raft_consensus.cc:2781] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:22.639691 10172 raft_consensus.cc:686] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 1 LEADER]: Becoming Leader. State: Replica: 41451b4ec7a94da7a879e855e935f433, State: Running, Role: LEADER
I20260810 03:49:22.640069 10172 consensus_queue.cc:237] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } }
I20260810 03:49:22.643395 9638 catalog_manager.cc:5495] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41451b4ec7a94da7a879e855e935f433 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "41451b4ec7a94da7a879e855e935f433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41451b4ec7a94da7a879e855e935f433" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 46045 } health_report { overall_health: HEALTHY } } }
I20260810 03:49:22.666911 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.663543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44402 (local address 127.22.134.195:46045)
0810 03:49:22.663676 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.663679 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.663692 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:49:22.663766 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.663768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.663820 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.663909 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:49:22.664116 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.664613 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.665473 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.665722 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.665808 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.666114 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:49:22.666546 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:49:22.666639 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.666732 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.666784 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:49:22.672940 9799 raft_consensus.cc:1261] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 1 FOLLOWER]: Refusing update from remote peer 41451b4ec7a94da7a879e855e935f433: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:22.672940 9949 raft_consensus.cc:1261] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 1 FOLLOWER]: Refusing update from remote peer 41451b4ec7a94da7a879e855e935f433: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:22.673681 10172 consensus_queue.cc:1035] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0bd52eab004f46adbe02473a4d1437" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 40183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:22.673892 10175 consensus_queue.cc:1035] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9c5111f0fb7471e977b2ff1d209a353" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 35085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:22.681068 10178 mvcc.cc:205] Tried to move back new op lower bound from 7316823091900637184 to 7316823091776888832. Current Snapshot: MvccSnapshot[applied={T|T < 7316823091900637184}]
I20260810 03:49:22.682675 10179 mvcc.cc:205] Tried to move back new op lower bound from 7316823091900637184 to 7316823091776888832. Current Snapshot: MvccSnapshot[applied={T|T < 7316823091900637184}]
I20260810 03:49:22.690385 9638 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:22.690577 9638 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:22.693112 9638 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 652108f04a7a46f1aa07aff678dd9ccb: Sending DeleteTablet for 3 replicas of tablet cfdb58f78f254307b690f3bc3392c480
I20260810 03:49:22.693981 9778 tablet_service.cc:1514] Processing DeleteTablet for tablet cfdb58f78f254307b690f3bc3392c480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:22 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:44096
I20260810 03:49:22.694164 9926 tablet_service.cc:1514] Processing DeleteTablet for tablet cfdb58f78f254307b690f3bc3392c480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:22 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:33042
I20260810 03:49:22.694186 10073 tablet_service.cc:1514] Processing DeleteTablet for tablet cfdb58f78f254307b690f3bc3392c480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:22 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:44400
I20260810 03:49:22.694635 10189 tablet_replica.cc:330] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: stopping tablet replica
I20260810 03:49:22.694798 10187 tablet_replica.cc:330] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353: stopping tablet replica
I20260810 03:49:22.695015 10189 raft_consensus.cc:2229] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:49:22.695169 10187 raft_consensus.cc:2229] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:22.695341 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 9705
I20260810 03:49:22.695549 10187 raft_consensus.cc:2258] T cfdb58f78f254307b690f3bc3392c480 P d9c5111f0fb7471e977b2ff1d209a353 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:22.698021 10189 raft_consensus.cc:2258] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:22.699388 10189 ts_tablet_manager.cc:1905] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:22.701812 10189 ts_tablet_manager.cc:1918] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:22.701925 10189 log.cc:1196] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/cfdb58f78f254307b690f3bc3392c480
I20260810 03:49:22.702278 10188 tablet_replica.cc:330] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437: stopping tablet replica
I20260810 03:49:22.702346 10189 ts_tablet_manager.cc:1939] T cfdb58f78f254307b690f3bc3392c480 P 41451b4ec7a94da7a879e855e935f433: Deleting consensus metadata
I20260810 03:49:22.702757 10188 raft_consensus.cc:2229] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:22.703171 10188 raft_consensus.cc:2258] T cfdb58f78f254307b690f3bc3392c480 P cb0bd52eab004f46adbe02473a4d1437 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:22.703855 9624 catalog_manager.cc:4841] TS 41451b4ec7a94da7a879e855e935f433 (127.22.134.195:46045): tablet cfdb58f78f254307b690f3bc3392c480 (table test-table [id=88cfb9f6811a43a89315f8a1f6bbe5c1]) successfully deleted
I20260810 03:49:22.704811 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 9854
W20260810 03:49:22.704831 9623 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:35085 (error 108)
I20260810 03:49:22.712040 10160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.711729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:35085 (local address 127.0.0.1:44098)
0810 03:49:22.711866 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.711947 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:35085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 03:49:22.712311 9623 catalog_manager.cc:4584] TS d9c5111f0fb7471e977b2ff1d209a353 (127.22.134.193:35085): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cfdb58f78f254307b690f3bc3392c480: Network error: Client connection negotiation failed: client connection to 127.22.134.193:35085: connect: Connection refused (error 111)
I20260810 03:49:22.717444 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 10003
I20260810 03:49:22.717599 10160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.717297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:40183 (local address 127.0.0.1:33046)
0810 03:49:22.717420 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:22.717478 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.194:40183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 03:49:22.726683 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 9601
2026-08-10T03:49:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2561 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T03:49:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:22Z Disabled control of system clock
I20260810 03:49:22.765543 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:36703
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:38341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:36703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:49:22.880182 10196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:22.880501 10196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:22.880576 10196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:22.884665 10196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:22.884815 10196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:22.884869 10196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:22.884907 10196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:22.884938 10196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:22.889891 10196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:36703
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:36703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:22.891160 10196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:22.892639 10196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:22.901487 10207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:22.901526 10202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:22.901513 10203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:22.901738 10196 server_base.cc:1034] running on GCE node
I20260810 03:49:22.902410 10196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:22.903635 10196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:22.904800 10196 hybrid_clock.cc:648] HybridClock initialized: now 1786333762904737 us; error 79 us; skew 500 ppm
I20260810 03:49:22.906775 10196 webserver.cc:460] Webserver started at http://127.22.134.254:44215/ using document root <none> and password file <none>
I20260810 03:49:22.907372 10196 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:22.907465 10196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:22.907697 10196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:22.909950 10196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "cc0644eabbfd27b271ee8acd47a27726"
server_key_iv: "04cce3131f01fac09a5c0eaa77b0fb6b"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.910583 10196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "cc0644eabbfd27b271ee8acd47a27726"
server_key_iv: "04cce3131f01fac09a5c0eaa77b0fb6b"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.914641 10196 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:22.917189 10214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:22.918478 10196 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:49:22.918619 10196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e"
format_stamp: "Formatted at 2026-08-10 03:49:22 on dist-test-slave-qg60"
server_key: "cc0644eabbfd27b271ee8acd47a27726"
server_key_iv: "04cce3131f01fac09a5c0eaa77b0fb6b"
server_key_version: "encryptionkey@0"
I20260810 03:49:22.918741 10196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:22.944582 10196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:22.945406 10196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:22.945624 10196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:22.952776 10196 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:36703
I20260810 03:49:22.952817 10270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:36703 every 8 connection(s)
I20260810 03:49:22.953830 10196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:22.957362 10271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:22.961938 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 10196
I20260810 03:49:22.962113 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:22.962381 23067 external_mini_cluster.cc:1428] Setting key e62c6ec091d70d985bc4a0e76d885d0c
I20260810 03:49:22.963568 10271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e: Bootstrap starting.
I20260810 03:49:22.966017 10271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:22.966957 10271 log.cc:824] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:22.969049 10271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e: No bootstrap required, opened a new log
I20260810 03:49:22.972411 10271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36703 } }
I20260810 03:49:22.972644 10271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:22.972702 10271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c85de42cf5240f5a89c1c5b0ab03d2e, State: Initialized, Role: FOLLOWER
I20260810 03:49:22.972867 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:22.963995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44708 (local address 127.22.134.254:36703)
0810 03:49:22.964643 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:22.964660 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:22.964697 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:49:22.965417 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:22.965433 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:22.965854 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:22.966173 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:22.966632 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.967686 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.968611 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:22.969199 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:22.969360 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:22.970421 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:22.970426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:22.970440 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:22.970893 (+ 453us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:22.970953 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:22.970974 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:22.971087 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:22.971237 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 03:49:22.971505 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":148,"threads_started":1}
I20260810 03:49:22.973261 10271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36703 } }
I20260810 03:49:22.973429 10271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:22.973496 10271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:22.973591 10271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:22.974646 10271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36703 } }
I20260810 03:49:22.974998 10271 leader_election.cc:302] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c85de42cf5240f5a89c1c5b0ab03d2e; no voters:
I20260810 03:49:22.975389 10271 leader_election.cc:288] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:22.975514 10276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:22.975811 10276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [term 1 LEADER]: Becoming Leader. State: Replica: 8c85de42cf5240f5a89c1c5b0ab03d2e, State: Running, Role: LEADER
I20260810 03:49:22.976290 10276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36703 } }
I20260810 03:49:22.976687 10271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:22.978376 10279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c85de42cf5240f5a89c1c5b0ab03d2e. Latest consensus state: current_term: 1 leader_uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36703 } } }
I20260810 03:49:22.978515 10279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:22.978922 10277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c85de42cf5240f5a89c1c5b0ab03d2e" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 36703 } } }
I20260810 03:49:22.979017 10277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e [sys.catalog]: This master's current role is: LEADER
W20260810 03:49:22.982066 10296 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:49:22.982169 10296 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:49:22.982256 10293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:22.983140 10293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:22.989321 10293 catalog_manager.cc:1347] Generated new cluster ID: 6a57ca6cc26b4d9c933627939877919c
I20260810 03:49:22.989482 10293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:23.011264 10293 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:23.012763 10293 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:23.025193 10293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e: Generated new TSK 0
I20260810 03:49:23.026047 10293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:23.039924 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36703
--builtin_ntp_servers=127.22.134.212:38341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:49:23.158349 10301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:23.158649 10301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:23.158692 10301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:23.162926 10301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:23.163007 10301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:23.163066 10301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:49:23.168046 10301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:23.169243 10301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:23.170596 10301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:23.180675 10308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:23.180712 10312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:23.180754 10307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:23.181128 10301 server_base.cc:1034] running on GCE node
I20260810 03:49:23.181581 10301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:23.182348 10301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:23.183574 10301 hybrid_clock.cc:648] HybridClock initialized: now 1786333763183555 us; error 35 us; skew 500 ppm
I20260810 03:49:23.185777 10301 webserver.cc:460] Webserver started at http://127.22.134.193:40549/ using document root <none> and password file <none>
I20260810 03:49:23.186461 10301 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:23.186570 10301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:23.186825 10301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:23.189263 10301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "e8af9cf489bc4e0e80e9321235c1af85"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "d6b709f745b774a92bb2eb566c7dbf9a"
server_key_iv: "baa2782a9cd7d5a40caeb21265cbd86a"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.189919 10301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "e8af9cf489bc4e0e80e9321235c1af85"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "d6b709f745b774a92bb2eb566c7dbf9a"
server_key_iv: "baa2782a9cd7d5a40caeb21265cbd86a"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.194159 10301 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:23.196995 10319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.198372 10301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:49:23.198473 10301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "e8af9cf489bc4e0e80e9321235c1af85"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "d6b709f745b774a92bb2eb566c7dbf9a"
server_key_iv: "baa2782a9cd7d5a40caeb21265cbd86a"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.198570 10301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:23.221210 10301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:23.221915 10301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:23.222074 10301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:23.222770 10301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:23.223810 10301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:23.223891 10301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.223935 10301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:23.223950 10301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.233095 10301 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:46217
I20260810 03:49:23.233170 10450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:46217 every 8 connection(s)
I20260810 03:49:23.234097 10301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:49:23.237813 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 10301
I20260810 03:49:23.237941 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:49:23.238219 23067 external_mini_cluster.cc:1428] Setting key fc9d23dd6f9d5e830198c17c465795b0
I20260810 03:49:23.240302 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36703
--builtin_ntp_servers=127.22.134.212:38341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:49:23.244374 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.236148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:38197 (local address 127.22.134.254:36703)
0810 03:49:23.236296 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.236299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.237452 (+ 1153us) server_negotiation.cc:407] Connection header received
0810 03:49:23.239117 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.239120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.239183 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.239288 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:23.240354 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.241038 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.242297 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.242527 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.242650 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.243841 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:23.243845 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:23.243848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:23.243863 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:23.243888 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:23.243895 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:23.243972 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.244150 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.244222 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 03:49:23.245524 10453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.236525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:36703 (local address 127.22.134.193:38197)
0810 03:49:23.237305 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.237349 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:23.238886 (+ 1537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:23.239470 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:23.239477 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:23.239590 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:23.240189 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.240208 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.241193 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.241195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.242166 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.242176 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.242698 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.242702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.242877 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.243554 (+ 677us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:23.243556 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:23.243604 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:23.243675 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:23.243987 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:23.244003 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:23.244008 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:49:23.244150 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 03:49:23.244465 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":178,"threads_started":1}
I20260810 03:49:23.246835 10451 heartbeater.cc:347] Connected to a master server at 127.22.134.254:36703
I20260810 03:49:23.247124 10451 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:23.247681 10451 heartbeater.cc:511] Master 127.22.134.254:36703 requested a full tablet report, sending...
I20260810 03:49:23.249481 10233 ts_manager.cc:194] Registered new tserver with Master: e8af9cf489bc4e0e80e9321235c1af85 (127.22.134.193:46217)
I20260810 03:49:23.251309 10233 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.193:38197
W20260810 03:49:23.355935 10454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:23.356233 10454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:23.356273 10454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:23.360530 10454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:23.360602 10454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:23.360659 10454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:49:23.365563 10454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:23.366714 10454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:23.368100 10454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:23.377969 10459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:23.377949 10462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:23.377965 10460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:23.378643 10454 server_base.cc:1034] running on GCE node
I20260810 03:49:23.379120 10454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:23.379832 10454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:23.381039 10454 hybrid_clock.cc:648] HybridClock initialized: now 1786333763381025 us; error 30 us; skew 500 ppm
I20260810 03:49:23.383136 10454 webserver.cc:460] Webserver started at http://127.22.134.194:41603/ using document root <none> and password file <none>
I20260810 03:49:23.383946 10454 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:23.384066 10454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:23.384295 10454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:23.387022 10454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "286dbdf25ccd41cc92f880ee987173ab"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "a435d2275b9fe1c9db8f766406b81b36"
server_key_iv: "ad3ea8f9dabd58769197886e3108600a"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.387671 10454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "286dbdf25ccd41cc92f880ee987173ab"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "a435d2275b9fe1c9db8f766406b81b36"
server_key_iv: "ad3ea8f9dabd58769197886e3108600a"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.391745 10454 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260810 03:49:23.394479 10471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.395771 10454 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:49:23.396026 10454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "286dbdf25ccd41cc92f880ee987173ab"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "a435d2275b9fe1c9db8f766406b81b36"
server_key_iv: "ad3ea8f9dabd58769197886e3108600a"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.396229 10454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:23.421722 10454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:23.422514 10454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:23.422744 10454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:23.423441 10454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:23.424516 10454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:23.424592 10454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.424674 10454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:23.424718 10454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.434219 10454 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:41023
I20260810 03:49:23.434243 10607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:41023 every 8 connection(s)
I20260810 03:49:23.435250 10454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:49:23.438370 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 10454
I20260810 03:49:23.438529 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:49:23.438865 23067 external_mini_cluster.cc:1428] Setting key 8e1ff80d71b5cbe3f1a55c4e2c92311c
I20260810 03:49:23.441064 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36703
--builtin_ntp_servers=127.22.134.212:38341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:49:23.447158 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.437416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:34249 (local address 127.22.134.254:36703)
0810 03:49:23.437598 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.437652 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.438882 (+ 1230us) server_negotiation.cc:407] Connection header received
0810 03:49:23.440644 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.440647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.440700 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.440811 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:23.441882 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.442714 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.444581 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.445148 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.445280 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.446458 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:23.446464 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:23.446469 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:23.446489 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:23.446515 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:23.446527 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:23.446620 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.446807 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.446896 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:49:23.448248 10610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.437888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:36703 (local address 127.22.134.194:34249)
0810 03:49:23.438688 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.438748 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:23.440426 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:23.440970 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:23.440978 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:23.441070 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:23.441731 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.441747 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.442885 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.442890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.444445 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.444457 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.445331 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.445334 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.445486 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.446169 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:23.446171 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:23.446215 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:23.446289 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:23.446647 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:23.446655 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:23.446661 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:49:23.446774 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 03:49:23.447033 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":152,"threads_started":1}
I20260810 03:49:23.449582 10608 heartbeater.cc:347] Connected to a master server at 127.22.134.254:36703
I20260810 03:49:23.449879 10608 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:23.450637 10608 heartbeater.cc:511] Master 127.22.134.254:36703 requested a full tablet report, sending...
I20260810 03:49:23.451897 10233 ts_manager.cc:194] Registered new tserver with Master: 286dbdf25ccd41cc92f880ee987173ab (127.22.134.194:41023)
I20260810 03:49:23.452535 10233 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.194:34249
W20260810 03:49:23.560638 10611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:23.560987 10611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:23.561058 10611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:23.565150 10611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:23.565213 10611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:23.565297 10611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:49:23.570243 10611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:36703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:23.571331 10611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:23.572718 10611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:23.582942 10616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:23.582930 10617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:23.583110 10611 server_base.cc:1034] running on GCE node
W20260810 03:49:23.582931 10619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:23.583633 10611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:23.584275 10611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:23.585462 10611 hybrid_clock.cc:648] HybridClock initialized: now 1786333763585447 us; error 28 us; skew 500 ppm
I20260810 03:49:23.587435 10611 webserver.cc:460] Webserver started at http://127.22.134.195:41205/ using document root <none> and password file <none>
I20260810 03:49:23.588048 10611 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:23.588208 10611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:23.588445 10611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:23.590633 10611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "2a936fccb79a44e388c4c01cb2eb662e"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "4dc1301855b4e90134a4a2a9ba24d039"
server_key_iv: "f9d661fb128a95bb8a8c978d5dd6a727"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.591248 10611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "2a936fccb79a44e388c4c01cb2eb662e"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "4dc1301855b4e90134a4a2a9ba24d039"
server_key_iv: "f9d661fb128a95bb8a8c978d5dd6a727"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.595355 10611 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:23.598078 10626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.599543 10611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:49:23.599716 10611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "2a936fccb79a44e388c4c01cb2eb662e"
format_stamp: "Formatted at 2026-08-10 03:49:23 on dist-test-slave-qg60"
server_key: "4dc1301855b4e90134a4a2a9ba24d039"
server_key_iv: "f9d661fb128a95bb8a8c978d5dd6a727"
server_key_version: "encryptionkey@0"
I20260810 03:49:23.599841 10611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:23.611608 10611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:23.612332 10611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:23.612534 10611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:23.613205 10611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:23.614176 10611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:23.614225 10611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.614265 10611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:23.614280 10611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:23.623924 10611 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:33531
I20260810 03:49:23.624010 10756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:33531 every 8 connection(s)
I20260810 03:49:23.624991 10611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:49:23.629431 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 10611
I20260810 03:49:23.629602 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:49:23.629904 23067 external_mini_cluster.cc:1428] Setting key 67eb1a327f9ec32b1e8e8883900efa13
I20260810 03:49:23.635224 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.627222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35297 (local address 127.22.134.254:36703)
0810 03:49:23.627373 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.627377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.628472 (+ 1095us) server_negotiation.cc:407] Connection header received
0810 03:49:23.630169 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.630172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.630245 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.630350 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:23.631352 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.631903 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.633274 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.633498 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.633604 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.634729 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:23.634732 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:23.634734 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:23.634746 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:23.634765 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:23.634773 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:23.634839 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.634972 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.635097 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 03:49:23.636093 10759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.627634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:36703 (local address 127.22.134.195:35297)
0810 03:49:23.628318 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.628361 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:23.629922 (+ 1561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:23.630533 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:23.630540 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:23.630673 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:23.631218 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.631232 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.632103 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.632107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.633152 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.633162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.633684 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.633687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.633833 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.634451 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:23.634453 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:23.634495 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:23.634562 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:23.634850 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:23.634856 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:23.634860 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 03:49:23.634956 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 03:49:23.635186 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":116,"threads_started":1}
I20260810 03:49:23.637398 10757 heartbeater.cc:347] Connected to a master server at 127.22.134.254:36703
I20260810 03:49:23.637667 10757 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:23.638454 10757 heartbeater.cc:511] Master 127.22.134.254:36703 requested a full tablet report, sending...
I20260810 03:49:23.639644 10233 ts_manager.cc:194] Registered new tserver with Master: 2a936fccb79a44e388c4c01cb2eb662e (127.22.134.195:33531)
I20260810 03:49:23.640254 10233 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.195:35297
I20260810 03:49:23.644272 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:49:23.650465 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.646385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57674 (local address 127.22.134.254:36703)
0810 03:49:23.646525 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.646529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.646727 (+ 198us) server_negotiation.cc:407] Connection header received
0810 03:49:23.646833 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.646836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.646878 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.646949 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:23.647262 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.647778 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.648650 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.648950 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.649128 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.649970 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:23.649973 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:23.649976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:23.649987 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:23.650077 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:23.650087 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:23.650158 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.650293 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.650347 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:49:23.653704 10233 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:49:23.656944 10233 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:49:23.672163 10772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.665996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38856 (local address 127.22.134.193:46217)
0810 03:49:23.666979 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.666992 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.667016 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:49:23.667110 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.667119 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.667354 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.667513 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:23.667836 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.669098 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.670884 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.671435 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.671585 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.671782 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.671876 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.671977 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":861,"thread_start_us":176,"threads_started":1}
I20260810 03:49:23.672159 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.665823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46217 (local address 127.0.0.1:38856)
0810 03:49:23.666454 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.666515 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:23.666657 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:23.667515 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:23.667520 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:23.667544 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:23.667686 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.667693 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.669219 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.669222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.670758 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.670768 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.671564 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.671567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.671681 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.671719 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 03:49:23.671837 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 03:49:23.671973 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":98,"spinlock_wait_cycles":9856,"thread_start_us":87,"threads_started":1}
I20260810 03:49:23.672850 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.666558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:41023 (local address 127.0.0.1:37668)
0810 03:49:23.667036 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.667049 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:23.667130 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:23.668271 (+ 1141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:23.668274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:23.668292 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:23.668392 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.668401 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.669489 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.669492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.670774 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.670785 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.672131 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.672138 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.672299 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.672386 (+ 87us) client_negotiation.cc:769] Sending connection context
0810 03:49:23.672475 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 03:49:23.672579 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":98,"thread_start_us":92,"threads_started":1}
I20260810 03:49:23.672883 10774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.666747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37668 (local address 127.22.134.194:41023)
0810 03:49:23.667850 (+ 1103us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.667863 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.667884 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:49:23.667956 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.667961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.668138 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.668281 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:23.668513 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.669376 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.670927 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.671720 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.671846 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.672009 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.672535 (+ 526us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.672653 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":991,"thread_start_us":113,"threads_started":1}
I20260810 03:49:23.673094 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.667024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48788 (local address 127.22.134.195:33531)
0810 03:49:23.667387 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.667397 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.667415 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:49:23.667504 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.667508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.667690 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.667828 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:23.668093 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.669216 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.670928 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.671720 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.671845 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.672009 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.672788 (+ 779us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.672903 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":131,"threads_started":1}
I20260810 03:49:23.676535 10770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.666002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:33531 (local address 127.0.0.1:48788)
0810 03:49:23.666477 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.666522 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:23.666657 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:23.667851 (+ 1194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:23.667855 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:23.667877 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:23.667973 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.667979 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.669333 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.669337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.670777 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.670785 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.672133 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.672138 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.672343 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.672389 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 03:49:23.672475 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 03:49:23.672579 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":189,"spinlock_wait_cycles":2304,"thread_start_us":115,"threads_started":1}
I20260810 03:49:23.676153 10376 tablet_service.cc:1467] Processing CreateTablet for tablet a88e7a2f8d07471bb799ba3f9276ae20 (DEFAULT_TABLE table=test-table [id=35954e12c0ee4798bd4b3dc4535b2802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:23.676149 10531 tablet_service.cc:1467] Processing CreateTablet for tablet a88e7a2f8d07471bb799ba3f9276ae20 (DEFAULT_TABLE table=test-table [id=35954e12c0ee4798bd4b3dc4535b2802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:23.677498 10376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a88e7a2f8d07471bb799ba3f9276ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:23.677498 10531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a88e7a2f8d07471bb799ba3f9276ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:23.679901 10680 tablet_service.cc:1467] Processing CreateTablet for tablet a88e7a2f8d07471bb799ba3f9276ae20 (DEFAULT_TABLE table=test-table [id=35954e12c0ee4798bd4b3dc4535b2802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:23.681079 10680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a88e7a2f8d07471bb799ba3f9276ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:23.686045 10776 tablet_bootstrap.cc:492] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab: Bootstrap starting.
I20260810 03:49:23.686674 10777 tablet_bootstrap.cc:492] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85: Bootstrap starting.
I20260810 03:49:23.687253 10778 tablet_bootstrap.cc:492] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Bootstrap starting.
I20260810 03:49:23.688573 10776 tablet_bootstrap.cc:654] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:23.688905 10777 tablet_bootstrap.cc:654] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:23.689456 10778 tablet_bootstrap.cc:654] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:23.689465 10776 log.cc:824] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:23.689776 10777 log.cc:824] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:23.690272 10778 log.cc:824] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:23.691712 10776 tablet_bootstrap.cc:492] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab: No bootstrap required, opened a new log
I20260810 03:49:23.691921 10776 ts_tablet_manager.cc:1397] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:49:23.692059 10777 tablet_bootstrap.cc:492] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85: No bootstrap required, opened a new log
I20260810 03:49:23.692145 10778 tablet_bootstrap.cc:492] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: No bootstrap required, opened a new log
I20260810 03:49:23.692261 10777 ts_tablet_manager.cc:1397] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 03:49:23.692340 10778 ts_tablet_manager.cc:1397] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 03:49:23.695451 10777 raft_consensus.cc:348] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.695705 10777 raft_consensus.cc:374] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:23.695760 10777 raft_consensus.cc:729] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8af9cf489bc4e0e80e9321235c1af85, State: Initialized, Role: FOLLOWER
I20260810 03:49:23.696225 10777 consensus_queue.cc:260] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.696416 10776 raft_consensus.cc:348] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.696416 10778 raft_consensus.cc:348] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.696671 10776 raft_consensus.cc:374] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:23.696671 10778 raft_consensus.cc:374] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:23.696756 10776 raft_consensus.cc:729] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286dbdf25ccd41cc92f880ee987173ab, State: Initialized, Role: FOLLOWER
I20260810 03:49:23.696766 10778 raft_consensus.cc:729] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a936fccb79a44e388c4c01cb2eb662e, State: Initialized, Role: FOLLOWER
I20260810 03:49:23.697250 10777 ts_tablet_manager.cc:1428] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
I20260810 03:49:23.697206 10778 consensus_queue.cc:260] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.697217 10776 consensus_queue.cc:260] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.697641 10451 heartbeater.cc:503] Master 127.22.134.254:36703 was elected leader, sending a full tablet report...
I20260810 03:49:23.698133 10776 ts_tablet_manager.cc:1428] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260810 03:49:23.698133 10778 ts_tablet_manager.cc:1428] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260810 03:49:23.698462 10608 heartbeater.cc:503] Master 127.22.134.254:36703 was elected leader, sending a full tablet report...
I20260810 03:49:23.699388 10757 heartbeater.cc:503] Master 127.22.134.254:36703 was elected leader, sending a full tablet report...
W20260810 03:49:23.735349 10452 tablet.cc:2369] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:49:23.871297 10783 raft_consensus.cc:482] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:23.871595 10783 raft_consensus.cc:504] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.873003 10783 leader_election.cc:288] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8af9cf489bc4e0e80e9321235c1af85 (127.22.134.193:46217), 286dbdf25ccd41cc92f880ee987173ab (127.22.134.194:41023)
W20260810 03:49:23.876030 10758 tablet.cc:2369] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:49:23.877517 10772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.873442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:44625 (local address 127.22.134.193:46217)
0810 03:49:23.873596 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.873601 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.873620 (+ 19us) server_negotiation.cc:407] Connection header received
0810 03:49:23.873762 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.873766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.873825 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.873927 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:23.874288 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.874916 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.876246 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.876881 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.876988 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.877068 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.877296 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.877376 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:49:23.877517 10759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.873302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46217 (local address 127.22.134.195:44625)
0810 03:49:23.873506 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.873527 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:23.873642 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:23.873961 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:23.873964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:23.873986 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:23.874135 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.874143 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.875042 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.875045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.876088 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.876100 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.877009 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.877016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.877142 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.877169 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 03:49:23.877233 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 03:49:23.877357 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260810 03:49:23.877571 10774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.873566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:51689 (local address 127.22.134.194:41023)
0810 03:49:23.873722 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.873728 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.873932 (+ 204us) server_negotiation.cc:407] Connection header received
0810 03:49:23.874139 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.874143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.874210 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.874303 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:23.874626 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.875295 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.876448 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.876915 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.877062 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.877115 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.877340 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.877442 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:49:23.877527 10785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.873364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:41023 (local address 127.22.134.195:51689)
0810 03:49:23.873825 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.873840 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:23.873944 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:23.874325 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:23.874328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:23.874346 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:23.874474 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.874480 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.875429 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.875432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.876258 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:23.876272 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.877085 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.877091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:23.877173 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.877190 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 03:49:23.877286 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 03:49:23.877359 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":178,"threads_started":1}
I20260810 03:49:23.878367 10401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a88e7a2f8d07471bb799ba3f9276ae20" candidate_uuid: "2a936fccb79a44e388c4c01cb2eb662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8af9cf489bc4e0e80e9321235c1af85" is_pre_election: true
I20260810 03:49:23.878391 10554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a88e7a2f8d07471bb799ba3f9276ae20" candidate_uuid: "2a936fccb79a44e388c4c01cb2eb662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286dbdf25ccd41cc92f880ee987173ab" is_pre_election: true
I20260810 03:49:23.878717 10554 raft_consensus.cc:2454] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a936fccb79a44e388c4c01cb2eb662e in term 0.
I20260810 03:49:23.878717 10401 raft_consensus.cc:2454] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a936fccb79a44e388c4c01cb2eb662e in term 0.
I20260810 03:49:23.879315 10627 leader_election.cc:302] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a936fccb79a44e388c4c01cb2eb662e, e8af9cf489bc4e0e80e9321235c1af85; no voters:
I20260810 03:49:23.879609 10783 raft_consensus.cc:2781] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:49:23.879694 10783 raft_consensus.cc:482] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:49:23.879726 10783 raft_consensus.cc:3037] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:23.880861 10783 raft_consensus.cc:504] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.881264 10783 leader_election.cc:288] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [CANDIDATE]: Term 1 election: Requested vote from peers e8af9cf489bc4e0e80e9321235c1af85 (127.22.134.193:46217), 286dbdf25ccd41cc92f880ee987173ab (127.22.134.194:41023)
I20260810 03:49:23.881669 10401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a88e7a2f8d07471bb799ba3f9276ae20" candidate_uuid: "2a936fccb79a44e388c4c01cb2eb662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8af9cf489bc4e0e80e9321235c1af85"
I20260810 03:49:23.881669 10554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a88e7a2f8d07471bb799ba3f9276ae20" candidate_uuid: "2a936fccb79a44e388c4c01cb2eb662e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286dbdf25ccd41cc92f880ee987173ab"
I20260810 03:49:23.881803 10554 raft_consensus.cc:3037] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:23.881803 10401 raft_consensus.cc:3037] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:23.883188 10401 raft_consensus.cc:2454] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a936fccb79a44e388c4c01cb2eb662e in term 1.
I20260810 03:49:23.883188 10554 raft_consensus.cc:2454] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a936fccb79a44e388c4c01cb2eb662e in term 1.
I20260810 03:49:23.883538 10631 leader_election.cc:302] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286dbdf25ccd41cc92f880ee987173ab, 2a936fccb79a44e388c4c01cb2eb662e; no voters:
I20260810 03:49:23.883762 10783 raft_consensus.cc:2781] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:23.883999 10783 raft_consensus.cc:686] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 1 LEADER]: Becoming Leader. State: Replica: 2a936fccb79a44e388c4c01cb2eb662e, State: Running, Role: LEADER
I20260810 03:49:23.884388 10783 consensus_queue.cc:237] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } }
I20260810 03:49:23.888170 10232 catalog_manager.cc:5495] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a936fccb79a44e388c4c01cb2eb662e (127.22.134.195). New cstate: current_term: 1 leader_uuid: "2a936fccb79a44e388c4c01cb2eb662e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a936fccb79a44e388c4c01cb2eb662e" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 33531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260810 03:49:23.912822 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.909120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48798 (local address 127.22.134.195:33531)
0810 03:49:23.909269 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:23.909273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:23.909287 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:49:23.909450 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:23.909453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:23.909509 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:23.909604 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:49:23.909840 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.910363 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.911255 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:23.911471 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:23.911569 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:23.911875 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:49:23.912389 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:49:23.912485 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:23.912561 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 03:49:23.912612 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 03:49:23.918985 10554 raft_consensus.cc:1261] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 1 FOLLOWER]: Refusing update from remote peer 2a936fccb79a44e388c4c01cb2eb662e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:23.918984 10401 raft_consensus.cc:1261] T a88e7a2f8d07471bb799ba3f9276ae20 P e8af9cf489bc4e0e80e9321235c1af85 [term 1 FOLLOWER]: Refusing update from remote peer 2a936fccb79a44e388c4c01cb2eb662e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:23.919772 10786 consensus_queue.cc:1035] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8af9cf489bc4e0e80e9321235c1af85" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 46217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:23.919979 10783 consensus_queue.cc:1035] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [LEADER]: Connected to new peer: Peer: permanent_uuid: "286dbdf25ccd41cc92f880ee987173ab" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:23.929438 10790 mvcc.cc:205] Tried to move back new op lower bound from 7316823097003970560 to 7316823096874778624. Current Snapshot: MvccSnapshot[applied={T|T < 7316823097003970560}]
I20260810 03:49:23.937109 10232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:23.937265 10232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:23.939844 10232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8c85de42cf5240f5a89c1c5b0ab03d2e: Sending DeleteTablet for 3 replicas of tablet a88e7a2f8d07471bb799ba3f9276ae20
I20260810 03:49:23.940801 10680 tablet_service.cc:1514] Processing DeleteTablet for tablet a88e7a2f8d07471bb799ba3f9276ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:23 UTC) from {username='slave'} at 127.0.0.1:48788
I20260810 03:49:23.940985 10376 tablet_service.cc:1514] Processing DeleteTablet for tablet a88e7a2f8d07471bb799ba3f9276ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:23 UTC) from {username='slave'} at 127.0.0.1:38856
I20260810 03:49:23.941232 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 10301
I20260810 03:49:23.941469 10800 tablet_replica.cc:330] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: stopping tablet replica
I20260810 03:49:23.941481 10531 tablet_service.cc:1514] Processing DeleteTablet for tablet a88e7a2f8d07471bb799ba3f9276ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:23 UTC) from {username='slave'} at 127.0.0.1:37668
I20260810 03:49:23.942085 10800 raft_consensus.cc:2229] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:49:23.942621 10800 raft_consensus.cc:2258] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:23.944962 10800 ts_tablet_manager.cc:1905] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:23.944990 10802 tablet_replica.cc:330] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab: stopping tablet replica
I20260810 03:49:23.945319 10802 raft_consensus.cc:2229] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:23.945679 10802 raft_consensus.cc:2258] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:23.948652 10800 ts_tablet_manager.cc:1918] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:23.948884 10800 log.cc:1196] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/a88e7a2f8d07471bb799ba3f9276ae20
I20260810 03:49:23.949230 10800 ts_tablet_manager.cc:1939] T a88e7a2f8d07471bb799ba3f9276ae20 P 2a936fccb79a44e388c4c01cb2eb662e: Deleting consensus metadata
I20260810 03:49:23.950379 10218 catalog_manager.cc:4841] TS 2a936fccb79a44e388c4c01cb2eb662e (127.22.134.195:33531): tablet a88e7a2f8d07471bb799ba3f9276ae20 (table test-table [id=35954e12c0ee4798bd4b3dc4535b2802]) successfully deleted
I20260810 03:49:23.954348 10802 ts_tablet_manager.cc:1905] T a88e7a2f8d07471bb799ba3f9276ae20 P 286dbdf25ccd41cc92f880ee987173ab: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 03:49:23.955439 10215 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:46217 (error 108)
I20260810 03:49:23.956323 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 10454
I20260810 03:49:23.961668 10770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.961310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:46217 (local address 127.0.0.1:38864)
0810 03:49:23.961498 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.961580 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:46217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260810 03:49:23.961858 10215 catalog_manager.cc:4584] TS e8af9cf489bc4e0e80e9321235c1af85 (127.22.134.193:46217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a88e7a2f8d07471bb799ba3f9276ae20: Network error: Client connection negotiation failed: client connection to 127.22.134.193:46217: connect: Connection refused (error 111)
I20260810 03:49:23.965346 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 10611
I20260810 03:49:23.965698 10770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:23.965392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:41023 (local address 127.0.0.1:37682)
0810 03:49:23.965568 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:23.965620 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.194:41023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260810 03:49:23.972324 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 10196
2026-08-10T03:49:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1240 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:24 dist-test-slave-qg60 krb5kdc[10806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:24 dist-test-slave-qg60 krb5kdc[10806](info): set up 2 sockets
Aug 10 03:49:24 dist-test-slave-qg60 krb5kdc[10806](info): commencing operation
krb5kdc: starting...
W20260810 03:49:25.133129 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:25 dist-test-slave-qg60 krb5kdc[10806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:25.276566 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40739
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:38781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:40739
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:25.390012 10821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:25.390518 10821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:25.390630 10821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:25.395403 10821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:25.395470 10821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:25.395490 10821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:25.395507 10821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:25.395524 10821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:25.400955 10821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:40739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:25.401998 10821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:25.402999 10821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:25.411755 10829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:25.411936 10821 server_base.cc:1034] running on GCE node
W20260810 03:49:25.411762 10826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:25.411787 10827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:25.412904 10821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:25.414093 10821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:25.415284 10821 hybrid_clock.cc:648] HybridClock initialized: now 1786333765415249 us; error 58 us; skew 500 ppm
Aug 10 03:49:25 dist-test-slave-qg60 krb5kdc[10806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:25.418891 10821 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:25.419937 10821 webserver.cc:460] Webserver started at http://127.22.134.254:42625/ using document root <none> and password file <none>
I20260810 03:49:25.420544 10821 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:25.420643 10821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:25.420905 10821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:25.423060 10821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "bafd6f9ab4084ad48a11ba4e728abc80"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "a92e4841fd61afef77062baa6793d03b"
server_key_iv: "0e97ac80218bf7e034c6055e839c42fe"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.423743 10821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "bafd6f9ab4084ad48a11ba4e728abc80"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "a92e4841fd61afef77062baa6793d03b"
server_key_iv: "0e97ac80218bf7e034c6055e839c42fe"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.428161 10821 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 03:49:25.431934 10837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:25.433900 10821 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260810 03:49:25.434131 10821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "bafd6f9ab4084ad48a11ba4e728abc80"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "a92e4841fd61afef77062baa6793d03b"
server_key_iv: "0e97ac80218bf7e034c6055e839c42fe"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.434300 10821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:25.450024 10821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:25.454469 10821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:25.454700 10821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:25.464756 10821 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:40739
I20260810 03:49:25.464799 10896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:40739 every 8 connection(s)
I20260810 03:49:25.466054 10821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:25.470089 10897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:25.474339 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 10821
I20260810 03:49:25.474493 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:25.474794 23067 external_mini_cluster.cc:1428] Setting key 8304626bd74b85c55d2c01804db9fa11
I20260810 03:49:25.478968 10897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80: Bootstrap starting.
I20260810 03:49:25.482151 10897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:25.483039 10897 log.cc:824] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80: Log is configured to *not* fsync() on all Append() calls
Aug 10 03:49:25 dist-test-slave-qg60 krb5kdc[10806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:25.485422 10897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80: No bootstrap required, opened a new log
I20260810 03:49:25.490516 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:25.476315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52588 (local address 127.22.134.254:40739)
0810 03:49:25.476823 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:25.476839 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:25.476875 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:49:25.477548 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:25.477565 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:25.477895 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:25.478246 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:25.479122 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:25.480096 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:25.481405 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:25.481925 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:25.482064 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:25.484861 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:25.484867 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:25.484885 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:25.484918 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:25.487052 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:25.487503 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:25.487511 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:25.487519 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:25.487668 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:25.487938 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:25.487943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:25.487945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:25.488589 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:25.488818 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:25.489094 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 03:49:25.489419 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":158,"threads_started":1}
I20260810 03:49:25.490566 10897 raft_consensus.cc:348] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bafd6f9ab4084ad48a11ba4e728abc80" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40739 } }
I20260810 03:49:25.490840 10897 raft_consensus.cc:374] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:25.490900 10897 raft_consensus.cc:729] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bafd6f9ab4084ad48a11ba4e728abc80, State: Initialized, Role: FOLLOWER
I20260810 03:49:25.491393 10897 consensus_queue.cc:260] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bafd6f9ab4084ad48a11ba4e728abc80" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40739 } }
I20260810 03:49:25.491552 10897 raft_consensus.cc:388] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:25.491672 10897 raft_consensus.cc:482] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:25.491786 10897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:25.492901 10897 raft_consensus.cc:504] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bafd6f9ab4084ad48a11ba4e728abc80" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40739 } }
I20260810 03:49:25.493271 10897 leader_election.cc:302] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bafd6f9ab4084ad48a11ba4e728abc80; no voters:
I20260810 03:49:25.493606 10897 leader_election.cc:288] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:25.493746 10903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:25.493973 10903 raft_consensus.cc:686] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [term 1 LEADER]: Becoming Leader. State: Replica: bafd6f9ab4084ad48a11ba4e728abc80, State: Running, Role: LEADER
I20260810 03:49:25.494355 10903 consensus_queue.cc:237] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bafd6f9ab4084ad48a11ba4e728abc80" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40739 } }
I20260810 03:49:25.494906 10897 sys_catalog.cc:564] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:25.496049 10904 sys_catalog.cc:455] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bafd6f9ab4084ad48a11ba4e728abc80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bafd6f9ab4084ad48a11ba4e728abc80" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40739 } } }
I20260810 03:49:25.496196 10904 sys_catalog.cc:458] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:25.496520 10905 sys_catalog.cc:455] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bafd6f9ab4084ad48a11ba4e728abc80. Latest consensus state: current_term: 1 leader_uuid: "bafd6f9ab4084ad48a11ba4e728abc80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bafd6f9ab4084ad48a11ba4e728abc80" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40739 } } }
I20260810 03:49:25.496604 10905 sys_catalog.cc:458] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:25.496615 10913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:25.499567 10913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:25.505272 10913 catalog_manager.cc:1347] Generated new cluster ID: b47ee3ddc6ff49d8a48ad29fb5f34df9
I20260810 03:49:25.505354 10913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:25.515048 10913 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:25.516470 10913 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:25.525064 10913 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80: Generated new TSK 0
I20260810 03:49:25.525915 10913 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:49:25.564917 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40739
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:38781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:25.694739 10926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:25.695040 10926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:25.695119 10926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:25.699565 10926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:25.699647 10926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:25.699743 10926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:49:25.705685 10926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:25.707139 10926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:25.708233 10926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:25.718255 10934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:25.718353 10926 server_base.cc:1034] running on GCE node
W20260810 03:49:25.718271 10931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:25.718271 10932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:25.719148 10926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:25.719856 10926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:25.721127 10926 hybrid_clock.cc:648] HybridClock initialized: now 1786333765721104 us; error 33 us; skew 500 ppm
Aug 10 03:49:25 dist-test-slave-qg60 krb5kdc[10806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:25.724490 10926 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:49:25.725608 10926 webserver.cc:460] Webserver started at http://127.22.134.193:38107/ using document root <none> and password file <none>
I20260810 03:49:25.726263 10926 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:25.726377 10926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:25.726640 10926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:25.729117 10926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "60ff342bc8934a4a85b3e7a83baccfe2"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "6d7d781b38ab040ab165c3d0146b743b"
server_key_iv: "69ea020e0f9180d63dbb4ed87b7dd704"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.729745 10926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "60ff342bc8934a4a85b3e7a83baccfe2"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "6d7d781b38ab040ab165c3d0146b743b"
server_key_iv: "69ea020e0f9180d63dbb4ed87b7dd704"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.734076 10926 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260810 03:49:25.736871 10941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:25.738322 10926 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:49:25.738489 10926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "60ff342bc8934a4a85b3e7a83baccfe2"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "6d7d781b38ab040ab165c3d0146b743b"
server_key_iv: "69ea020e0f9180d63dbb4ed87b7dd704"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.738628 10926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:25.753821 10926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:25.757400 10926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:25.757624 10926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:25.758234 10926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:25.759097 10926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:25.759166 10926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:25.759235 10926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:25.759282 10926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:25.768989 10926 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:32923
I20260810 03:49:25.769016 11070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:32923 every 8 connection(s)
I20260810 03:49:25.769975 10926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:49:25.773460 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 10926
I20260810 03:49:25.773638 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:49:25.774017 23067 external_mini_cluster.cc:1428] Setting key 4757523112812e209b4fe9fa3e415e11
Aug 10 03:49:25 dist-test-slave-qg60 krb5kdc[10806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:49:25.786432 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:25.772003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:34343 (local address 127.22.134.254:40739)
0810 03:49:25.772169 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:25.772172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:25.773089 (+ 917us) server_negotiation.cc:407] Connection header received
0810 03:49:25.774880 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:25.774884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:25.774941 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:25.775050 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:25.776617 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:25.777216 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:25.778661 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:25.779066 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:25.779204 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:25.782691 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:25.782694 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:25.782696 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:25.782722 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:25.784206 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:25.784767 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:25.784770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:25.784772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:25.784854 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:25.785269 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:25.785274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:25.785276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:25.785484 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:25.785625 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:25.786121 (+ 496us) server_negotiation.cc:299] Negotiation successful
0810 03:49:25.786257 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 03:49:25.787379 11073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:25.772423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40739 (local address 127.22.134.193:34343)
0810 03:49:25.772941 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:25.772986 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:25.774659 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:25.775235 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:25.775242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:25.775688 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:25.776434 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:25.776458 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:25.777349 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:25.777356 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:25.778506 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:25.778516 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:25.779266 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:25.779274 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:25.779518 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:25.780485 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:25.780512 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:25.782471 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:25.784338 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:25.784344 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:25.784361 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:25.784632 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:25.784958 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:25.784961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:25.784963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:25.785165 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:25.785594 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:25.785601 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:25.785876 (+ 275us) client_negotiation.cc:769] Sending connection context
0810 03:49:25.786087 (+ 211us) client_negotiation.cc:240] Negotiation successful
0810 03:49:25.786432 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:49:25.788836 11071 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40739
I20260810 03:49:25.789119 11071 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:25.789748 11071 heartbeater.cc:511] Master 127.22.134.254:40739 requested a full tablet report, sending...
I20260810 03:49:25.791392 10857 ts_manager.cc:194] Registered new tserver with Master: 60ff342bc8934a4a85b3e7a83baccfe2 (127.22.134.193:32923)
I20260810 03:49:25.792518 10857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:34343
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:49:25.808600 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40739
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:38781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:25.925446 11076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:25.925734 11076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:25.925778 11076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:25.929998 11076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:25.930085 11076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:25.930150 11076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:49:25.935977 11076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:25.937234 11076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:25.938333 11076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:25.948640 11086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:25.948792 11083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:25.948851 11076 server_base.cc:1034] running on GCE node
W20260810 03:49:25.948858 11084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:25.949575 11076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:25.950340 11076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:25.951525 11076 hybrid_clock.cc:648] HybridClock initialized: now 1786333765951503 us; error 37 us; skew 500 ppm
Aug 10 03:49:25 dist-test-slave-qg60 krb5kdc[10806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:25.954746 11076 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:49:25.955856 11076 webserver.cc:460] Webserver started at http://127.22.134.194:44261/ using document root <none> and password file <none>
I20260810 03:49:25.956460 11076 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:25.956528 11076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:25.956807 11076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:25.959129 11076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "9e065726bc0e41eb8480048192786ede"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "4949c529d69bc99c8cde9a86ad77641c"
server_key_iv: "0a273a9a26b3b36f713f541891a9f125"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.959728 11076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "9e065726bc0e41eb8480048192786ede"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "4949c529d69bc99c8cde9a86ad77641c"
server_key_iv: "0a273a9a26b3b36f713f541891a9f125"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.963924 11076 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 03:49:25.967207 11094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:25.968670 11076 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 03:49:25.968873 11076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "9e065726bc0e41eb8480048192786ede"
format_stamp: "Formatted at 2026-08-10 03:49:25 on dist-test-slave-qg60"
server_key: "4949c529d69bc99c8cde9a86ad77641c"
server_key_iv: "0a273a9a26b3b36f713f541891a9f125"
server_key_version: "encryptionkey@0"
I20260810 03:49:25.969024 11076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:26.009196 11076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:26.013144 11076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:26.013384 11076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:26.014071 11076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:26.015031 11076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:26.015105 11076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:26.015174 11076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:26.015221 11076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:26.024782 11076 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:44689
I20260810 03:49:26.024808 11222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:44689 every 8 connection(s)
I20260810 03:49:26.025851 11076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:49:26.026876 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 11076
I20260810 03:49:26.027032 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:49:26.027302 23067 external_mini_cluster.cc:1428] Setting key 6363ef03fcb1e3b6a6f4b0ac875d4e36
Aug 10 03:49:26 dist-test-slave-qg60 krb5kdc[10806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:49:26.041611 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.027843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:51523 (local address 127.22.134.254:40739)
0810 03:49:26.027992 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.027997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.028931 (+ 934us) server_negotiation.cc:407] Connection header received
0810 03:49:26.030308 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.030314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.030381 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.030471 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:26.031689 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.032532 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.033760 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.034152 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.034286 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.037238 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:26.037244 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:26.037249 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:26.037284 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:26.039064 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:26.039645 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:26.039647 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:26.039649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:26.039736 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:26.040227 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:26.040230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:26.040231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:26.040431 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:26.040516 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.041318 (+ 802us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.041473 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
I20260810 03:49:26.042606 11225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.028271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40739 (local address 127.22.134.194:51523)
0810 03:49:26.028769 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:26.028825 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:26.030093 (+ 1268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:26.030659 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:26.030666 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:26.031036 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:26.031535 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.031548 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.032675 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.032677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.033640 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.033650 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.034301 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.034304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.034452 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.035359 (+ 907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:26.035387 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:26.037037 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:26.039193 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:26.039198 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:26.039220 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:26.039496 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:26.039883 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:26.039885 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:26.039887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:26.040076 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:26.040559 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:26.040566 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:26.040926 (+ 360us) client_negotiation.cc:769] Sending connection context
0810 03:49:26.041164 (+ 238us) client_negotiation.cc:240] Negotiation successful
0810 03:49:26.041546 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":133,"threads_started":1}
I20260810 03:49:26.044184 11223 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40739
I20260810 03:49:26.044469 11223 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:26.045218 11223 heartbeater.cc:511] Master 127.22.134.254:40739 requested a full tablet report, sending...
I20260810 03:49:26.046617 10857 ts_manager.cc:194] Registered new tserver with Master: 9e065726bc0e41eb8480048192786ede (127.22.134.194:44689)
I20260810 03:49:26.047242 10857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:51523
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:49:26.061635 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40739
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:38781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:26.177708 11229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:26.178017 11229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:26.178090 11229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:26.182374 11229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:26.182448 11229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:26.182542 11229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:49:26.188329 11229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:40739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:26.189551 11229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:26.190619 11229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:26.200969 11237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:26.201138 11229 server_base.cc:1034] running on GCE node
W20260810 03:49:26.201202 11241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:26.200995 11235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:26.201826 11229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:26.202514 11229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:26.203691 11229 hybrid_clock.cc:648] HybridClock initialized: now 1786333766203654 us; error 50 us; skew 500 ppm
Aug 10 03:49:26 dist-test-slave-qg60 krb5kdc[10806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:26.206806 11229 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:49:26.207808 11229 webserver.cc:460] Webserver started at http://127.22.134.195:43733/ using document root <none> and password file <none>
I20260810 03:49:26.208420 11229 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:26.208513 11229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:26.208799 11229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:26.211078 11229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "286dfe3fdef84bef9f1d79bc3a6efd50"
format_stamp: "Formatted at 2026-08-10 03:49:26 on dist-test-slave-qg60"
server_key: "027f9dd6fb91983255e4e3e7890d650c"
server_key_iv: "1355c7b5401e0ad197fde4060c5358d1"
server_key_version: "encryptionkey@0"
I20260810 03:49:26.211688 11229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "286dfe3fdef84bef9f1d79bc3a6efd50"
format_stamp: "Formatted at 2026-08-10 03:49:26 on dist-test-slave-qg60"
server_key: "027f9dd6fb91983255e4e3e7890d650c"
server_key_iv: "1355c7b5401e0ad197fde4060c5358d1"
server_key_version: "encryptionkey@0"
I20260810 03:49:26.215756 11229 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 03:49:26.218321 11248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:26.219559 11229 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:49:26.219723 11229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "286dfe3fdef84bef9f1d79bc3a6efd50"
format_stamp: "Formatted at 2026-08-10 03:49:26 on dist-test-slave-qg60"
server_key: "027f9dd6fb91983255e4e3e7890d650c"
server_key_iv: "1355c7b5401e0ad197fde4060c5358d1"
server_key_version: "encryptionkey@0"
I20260810 03:49:26.219842 11229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:26.235615 11229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:26.239132 11229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:26.239354 11229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:26.239969 11229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:26.241094 11229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:26.241163 11229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:26.241241 11229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:26.241266 11229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:26.250286 11229 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:34963
I20260810 03:49:26.250362 11381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:34963 every 8 connection(s)
I20260810 03:49:26.251240 11229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:49:26.259832 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 11229
I20260810 03:49:26.260008 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:49:26.260365 23067 external_mini_cluster.cc:1428] Setting key 2855b7fcd1bbb2187fcec9cda3274f26
Aug 10 03:49:26 dist-test-slave-qg60 krb5kdc[10806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:26.266125 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.253297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:55843 (local address 127.22.134.254:40739)
0810 03:49:26.253472 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.253476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.254321 (+ 845us) server_negotiation.cc:407] Connection header received
0810 03:49:26.255637 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.255640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.255691 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.255771 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:26.257199 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.257734 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.258948 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.259228 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.259324 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.262041 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:26.262044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:26.262046 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:26.262070 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:26.263829 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:26.264445 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:26.264448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:26.264450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:26.264552 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:26.264973 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:26.264977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:26.264978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:26.265180 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:26.265287 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.265821 (+ 534us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.265955 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:49:26.267020 11384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.253648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:40739 (local address 127.22.134.195:55843)
0810 03:49:26.254158 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:26.254206 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:26.255421 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:26.255938 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:26.255944 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:26.256378 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:26.257012 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.257034 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.257844 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.257847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.258829 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.258839 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.259379 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.259382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.259524 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.260205 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:26.260222 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:26.261899 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:26.263955 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:26.263962 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:26.263978 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:26.264334 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:26.264653 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:26.264656 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:26.264658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:26.264871 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:26.265285 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:26.265293 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:26.265574 (+ 281us) client_negotiation.cc:769] Sending connection context
0810 03:49:26.265763 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 03:49:26.266135 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":109,"threads_started":1}
I20260810 03:49:26.268131 11382 heartbeater.cc:347] Connected to a master server at 127.22.134.254:40739
I20260810 03:49:26.268394 11382 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:26.268965 11382 heartbeater.cc:511] Master 127.22.134.254:40739 requested a full tablet report, sending...
I20260810 03:49:26.270114 10857 ts_manager.cc:194] Registered new tserver with Master: 286dfe3fdef84bef9f1d79bc3a6efd50 (127.22.134.195:34963)
I20260810 03:49:26.270723 10857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:55843
I20260810 03:49:26.274345 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:49:26.284556 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.276370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52604 (local address 127.22.134.254:40739)
0810 03:49:26.276515 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.276520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.276756 (+ 236us) server_negotiation.cc:407] Connection header received
0810 03:49:26.276903 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.276907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.276953 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.277036 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:26.277798 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.278316 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.279153 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.279376 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.279481 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.281229 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:26.281232 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:26.281235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:26.281267 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:26.282693 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:26.283216 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:26.283225 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:26.283227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:26.283303 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:26.283639 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:26.283646 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:26.283648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:26.283852 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:26.284011 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.284294 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.284394 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:49:26.288033 10857 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:49:26.291253 10857 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:49:26.306728 11395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.300575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:34963 (local address 127.0.0.1:47564)
0810 03:49:26.301631 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:26.301707 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:26.301856 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:26.302520 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:26.302526 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:26.302562 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:26.302747 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.302756 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.303967 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.303971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.305293 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.305303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.306118 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.306122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.306263 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.306311 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 03:49:26.306436 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 03:49:26.306564 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"mutex_wait_us":1,"thread_start_us":720,"threads_started":1}
I20260810 03:49:26.306737 11400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.300982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47564 (local address 127.22.134.195:34963)
0810 03:49:26.301376 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.301631 (+ 255us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.302004 (+ 373us) server_negotiation.cc:407] Connection header received
0810 03:49:26.302091 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.302096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.302327 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.302576 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:26.302888 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.303832 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.305414 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.305994 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.306130 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.306275 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.306468 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.306565 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":200,"threads_started":1}
I20260810 03:49:26.307446 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.301066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:32923 (local address 127.0.0.1:33052)
0810 03:49:26.301784 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:26.301796 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:26.301865 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:26.302859 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:26.302862 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:26.302881 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:26.303015 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.303022 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.304415 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.304418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.305712 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.305724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.306953 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.306957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.307051 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.307075 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:49:26.307198 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 03:49:26.307311 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":23,"thread_start_us":119,"threads_started":1}
I20260810 03:49:26.307792 11401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.301310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33052 (local address 127.22.134.193:32923)
0810 03:49:26.302244 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.302250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.302308 (+ 58us) server_negotiation.cc:407] Connection header received
0810 03:49:26.302422 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.302430 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.302711 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.302889 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:26.303124 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.304277 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.305882 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.306820 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.307323 (+ 503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.307444 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.307500 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.307627 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793,"thread_start_us":116,"threads_started":1}
I20260810 03:49:26.307909 11394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.300350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:44689 (local address 127.0.0.1:54026)
0810 03:49:26.301848 (+ 1498us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:26.301867 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:26.301959 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:26.302944 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:26.302947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:26.302964 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:26.303134 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.303141 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.304559 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.304562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.305745 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.305755 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.307050 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.307053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.307598 (+ 545us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.307620 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:49:26.307702 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 03:49:26.307769 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1104,"mutex_wait_us":79,"thread_start_us":83,"threads_started":1}
I20260810 03:49:26.308386 11396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.300586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54026 (local address 127.22.134.194:44689)
0810 03:49:26.302312 (+ 1726us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.302329 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.302350 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:49:26.302409 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.302413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.302617 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.302777 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:26.303267 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.304420 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.305882 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.306721 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.306851 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.306995 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.308141 (+ 1146us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.308243 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1607,"thread_start_us":122,"threads_started":1}
I20260810 03:49:26.310446 10995 tablet_service.cc:1467] Processing CreateTablet for tablet 4801e2e65b684677aae8da8e52bdae1c (DEFAULT_TABLE table=test-table [id=44a62f2e713549828167b6f3ccd60d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:26.310448 11302 tablet_service.cc:1467] Processing CreateTablet for tablet 4801e2e65b684677aae8da8e52bdae1c (DEFAULT_TABLE table=test-table [id=44a62f2e713549828167b6f3ccd60d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:26.310616 11148 tablet_service.cc:1467] Processing CreateTablet for tablet 4801e2e65b684677aae8da8e52bdae1c (DEFAULT_TABLE table=test-table [id=44a62f2e713549828167b6f3ccd60d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:26.311543 11148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4801e2e65b684677aae8da8e52bdae1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:26.311542 11302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4801e2e65b684677aae8da8e52bdae1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:26.311556 10995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4801e2e65b684677aae8da8e52bdae1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:26.318260 11402 tablet_bootstrap.cc:492] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: Bootstrap starting.
I20260810 03:49:26.320879 11402 tablet_bootstrap.cc:654] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:26.321128 11404 tablet_bootstrap.cc:492] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Bootstrap starting.
I20260810 03:49:26.321324 11403 tablet_bootstrap.cc:492] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2: Bootstrap starting.
I20260810 03:49:26.322242 11402 log.cc:824] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:26.323341 11404 tablet_bootstrap.cc:654] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:26.323448 11403 tablet_bootstrap.cc:654] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:26.324225 11403 log.cc:824] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:26.324563 11404 log.cc:824] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:26.324616 11402 tablet_bootstrap.cc:492] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: No bootstrap required, opened a new log
I20260810 03:49:26.324824 11402 ts_tablet_manager.cc:1397] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260810 03:49:26.326295 11404 tablet_bootstrap.cc:492] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: No bootstrap required, opened a new log
I20260810 03:49:26.326443 11403 tablet_bootstrap.cc:492] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2: No bootstrap required, opened a new log
I20260810 03:49:26.326546 11404 ts_tablet_manager.cc:1397] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 03:49:26.326632 11403 ts_tablet_manager.cc:1397] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 03:49:26.329049 11402 raft_consensus.cc:348] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.329356 11402 raft_consensus.cc:374] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:26.329411 11402 raft_consensus.cc:729] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e065726bc0e41eb8480048192786ede, State: Initialized, Role: FOLLOWER
I20260810 03:49:26.329490 11404 raft_consensus.cc:348] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.329749 11404 raft_consensus.cc:374] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:26.329802 11404 raft_consensus.cc:729] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286dfe3fdef84bef9f1d79bc3a6efd50, State: Initialized, Role: FOLLOWER
I20260810 03:49:26.329948 11402 consensus_queue.cc:260] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.330238 11404 consensus_queue.cc:260] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.331059 11402 ts_tablet_manager.cc:1428] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:49:26.331199 11404 ts_tablet_manager.cc:1428] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 03:49:26.331303 11382 heartbeater.cc:503] Master 127.22.134.254:40739 was elected leader, sending a full tablet report...
I20260810 03:49:26.331151 11403 raft_consensus.cc:348] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.331400 11403 raft_consensus.cc:374] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:26.331406 11223 heartbeater.cc:503] Master 127.22.134.254:40739 was elected leader, sending a full tablet report...
I20260810 03:49:26.331453 11403 raft_consensus.cc:729] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ff342bc8934a4a85b3e7a83baccfe2, State: Initialized, Role: FOLLOWER
I20260810 03:49:26.331861 11403 consensus_queue.cc:260] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.332873 11403 ts_tablet_manager.cc:1428] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2: Time spent starting tablet: real 0.006s user 0.003s sys 0.005s
I20260810 03:49:26.332964 11071 heartbeater.cc:503] Master 127.22.134.254:40739 was elected leader, sending a full tablet report...
I20260810 03:49:26.449640 11411 raft_consensus.cc:482] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:26.449892 11411 raft_consensus.cc:504] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.451100 11411 leader_election.cc:288] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e065726bc0e41eb8480048192786ede (127.22.134.194:44689), 60ff342bc8934a4a85b3e7a83baccfe2 (127.22.134.193:32923)
I20260810 03:49:26.455490 11396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.451571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:42853 (local address 127.22.134.194:44689)
0810 03:49:26.451730 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.451735 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.451751 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:49:26.451841 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.451851 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.451904 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.451997 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:26.452422 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.453108 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.454317 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.454898 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.455000 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.455043 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.455320 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.455391 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:49:26.455497 11384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.451435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:44689 (local address 127.22.134.195:42853)
0810 03:49:26.451587 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:26.451602 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:26.451736 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:26.452128 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:26.452131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:26.452151 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:26.452302 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.452309 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.453257 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.453260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.454186 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.454196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.455034 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.455038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.455151 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.455178 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 03:49:26.455271 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 03:49:26.455345 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 03:49:26.456202 11413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.451740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:32923 (local address 127.22.134.195:43483)
0810 03:49:26.452086 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:26.452101 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:26.452234 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:26.452526 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:26.452529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:26.452545 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:26.452678 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.452683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.453637 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.453640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.454613 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:26.454623 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.455758 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.455765 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:26.455863 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.455882 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 03:49:26.455986 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 03:49:26.456055 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":152,"threads_started":1}
I20260810 03:49:26.456243 11401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.451883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:43483 (local address 127.22.134.193:32923)
0810 03:49:26.452125 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.452129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.452168 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:49:26.452353 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.452359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.452421 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.452515 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:26.452831 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.453506 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.454757 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.455458 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.455589 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.455646 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.456024 (+ 378us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.456115 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:49:26.456446 11170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4801e2e65b684677aae8da8e52bdae1c" candidate_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e065726bc0e41eb8480048192786ede" is_pre_election: true
I20260810 03:49:26.456838 11170 raft_consensus.cc:2454] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286dfe3fdef84bef9f1d79bc3a6efd50 in term 0.
I20260810 03:49:26.457289 11022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4801e2e65b684677aae8da8e52bdae1c" candidate_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" is_pre_election: true
I20260810 03:49:26.457365 11250 leader_election.cc:302] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286dfe3fdef84bef9f1d79bc3a6efd50, 9e065726bc0e41eb8480048192786ede; no voters:
I20260810 03:49:26.457597 11022 raft_consensus.cc:2454] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286dfe3fdef84bef9f1d79bc3a6efd50 in term 0.
I20260810 03:49:26.457639 11411 raft_consensus.cc:2781] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:49:26.457727 11411 raft_consensus.cc:482] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:49:26.457775 11411 raft_consensus.cc:3037] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:26.459035 11411 raft_consensus.cc:504] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.459419 11411 leader_election.cc:288] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [CANDIDATE]: Term 1 election: Requested vote from peers 9e065726bc0e41eb8480048192786ede (127.22.134.194:44689), 60ff342bc8934a4a85b3e7a83baccfe2 (127.22.134.193:32923)
I20260810 03:49:26.459762 11170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4801e2e65b684677aae8da8e52bdae1c" candidate_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e065726bc0e41eb8480048192786ede"
I20260810 03:49:26.459860 11022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4801e2e65b684677aae8da8e52bdae1c" candidate_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60ff342bc8934a4a85b3e7a83baccfe2"
I20260810 03:49:26.459904 11170 raft_consensus.cc:3037] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:26.460000 11022 raft_consensus.cc:3037] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:26.461408 11022 raft_consensus.cc:2454] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286dfe3fdef84bef9f1d79bc3a6efd50 in term 1.
I20260810 03:49:26.461408 11170 raft_consensus.cc:2454] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286dfe3fdef84bef9f1d79bc3a6efd50 in term 1.
I20260810 03:49:26.461757 11250 leader_election.cc:302] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286dfe3fdef84bef9f1d79bc3a6efd50, 9e065726bc0e41eb8480048192786ede; no voters:
I20260810 03:49:26.461941 11411 raft_consensus.cc:2781] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:26.462200 11411 raft_consensus.cc:686] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 1 LEADER]: Becoming Leader. State: Replica: 286dfe3fdef84bef9f1d79bc3a6efd50, State: Running, Role: LEADER
I20260810 03:49:26.462589 11411 consensus_queue.cc:237] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } }
I20260810 03:49:26.466068 10854 catalog_manager.cc:5495] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 286dfe3fdef84bef9f1d79bc3a6efd50 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "286dfe3fdef84bef9f1d79bc3a6efd50" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 34963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260810 03:49:26.499377 11400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.495651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.22.134.195:34963)
0810 03:49:26.495787 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.495791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.495806 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:49:26.496001 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.496004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.496062 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.496197 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:49:26.496431 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.497060 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.497917 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.498161 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.498241 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.498515 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:49:26.498936 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:49:26.499050 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.499202 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.499242 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260810 03:49:26.502759 11383 tablet.cc:2369] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:49:26.506168 11170 raft_consensus.cc:1261] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 1 FOLLOWER]: Refusing update from remote peer 286dfe3fdef84bef9f1d79bc3a6efd50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:26.506168 11022 raft_consensus.cc:1261] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [term 1 FOLLOWER]: Refusing update from remote peer 286dfe3fdef84bef9f1d79bc3a6efd50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:26.507037 11411 consensus_queue.cc:1035] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e065726bc0e41eb8480048192786ede" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 44689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:26.507282 11414 consensus_queue.cc:1035] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ff342bc8934a4a85b3e7a83baccfe2" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:26.517159 11419 mvcc.cc:205] Tried to move back new op lower bound from 7316823107600654336 to 7316823107433353216. Current Snapshot: MvccSnapshot[applied={T|T < 7316823107600654336}]
I20260810 03:49:26.527885 10854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:26.528110 10854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:26.530926 10854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bafd6f9ab4084ad48a11ba4e728abc80: Sending DeleteTablet for 3 replicas of tablet 4801e2e65b684677aae8da8e52bdae1c
I20260810 03:49:26.531817 11148 tablet_service.cc:1514] Processing DeleteTablet for tablet 4801e2e65b684677aae8da8e52bdae1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:26 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:54026
I20260810 03:49:26.532006 11302 tablet_service.cc:1514] Processing DeleteTablet for tablet 4801e2e65b684677aae8da8e52bdae1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:26 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:47564
I20260810 03:49:26.532451 11428 tablet_replica.cc:330] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: stopping tablet replica
I20260810 03:49:26.532538 11429 tablet_replica.cc:330] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: stopping tablet replica
I20260810 03:49:26.532471 10995 tablet_service.cc:1514] Processing DeleteTablet for tablet 4801e2e65b684677aae8da8e52bdae1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:26 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:33052
I20260810 03:49:26.532940 11429 raft_consensus.cc:2229] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:49:26.532940 11428 raft_consensus.cc:2229] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:26.533389 11429 raft_consensus.cc:2258] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:26.533389 11428 raft_consensus.cc:2258] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:26.533408 11430 tablet_replica.cc:330] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2: stopping tablet replica
I20260810 03:49:26.533730 11430 raft_consensus.cc:2229] T 4801e2e65b684677aae8da8e52bdae1c P 60ff342bc8934a4a85b3e7a83baccfe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:26.533821 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 10926
I20260810 03:49:26.538087 11428 ts_tablet_manager.cc:1905] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:26.538538 11429 ts_tablet_manager.cc:1905] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:26.541496 11429 ts_tablet_manager.cc:1918] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:26.541610 11429 log.cc:1196] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/4801e2e65b684677aae8da8e52bdae1c
I20260810 03:49:26.541954 11429 ts_tablet_manager.cc:1939] T 4801e2e65b684677aae8da8e52bdae1c P 286dfe3fdef84bef9f1d79bc3a6efd50: Deleting consensus metadata
I20260810 03:49:26.542429 11428 ts_tablet_manager.cc:1918] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:26.542598 11428 log.cc:1196] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/4801e2e65b684677aae8da8e52bdae1c
I20260810 03:49:26.543001 11428 ts_tablet_manager.cc:1939] T 4801e2e65b684677aae8da8e52bdae1c P 9e065726bc0e41eb8480048192786ede: Deleting consensus metadata
I20260810 03:49:26.543299 10841 catalog_manager.cc:4841] TS 286dfe3fdef84bef9f1d79bc3a6efd50 (127.22.134.195:34963): tablet 4801e2e65b684677aae8da8e52bdae1c (table test-table [id=44a62f2e713549828167b6f3ccd60d08]) successfully deleted
W20260810 03:49:26.544026 10838 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:32923 (error 108)
I20260810 03:49:26.544608 10838 catalog_manager.cc:4841] TS 9e065726bc0e41eb8480048192786ede (127.22.134.194:44689): tablet 4801e2e65b684677aae8da8e52bdae1c (table test-table [id=44a62f2e713549828167b6f3ccd60d08]) successfully deleted
I20260810 03:49:26.545297 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 11076
I20260810 03:49:26.545450 11394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.545027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:32923 (local address 127.0.0.1:33054)
0810 03:49:26.545250 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:26.545335 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:32923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260810 03:49:26.553507 10838 catalog_manager.cc:4584] TS 60ff342bc8934a4a85b3e7a83baccfe2 (127.22.134.193:32923): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4801e2e65b684677aae8da8e52bdae1c: Network error: Client connection negotiation failed: client connection to 127.22.134.193:32923: connect: Connection refused (error 111)
I20260810 03:49:26.559258 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 11229
I20260810 03:49:26.568004 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 10821
2026-08-10T03:49:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2598 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T03:49:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:26Z Disabled control of system clock
I20260810 03:49:26.604976 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:32963
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:44793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:32963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:49:26.723320 11435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:26.723608 11435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:26.723644 11435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:26.727735 11435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:26.727810 11435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:26.727826 11435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:26.727843 11435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:26.727859 11435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:26.732690 11435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:32963
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:32963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:26.733935 11435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:26.735319 11435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:26.744184 11440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:26.744196 11442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:26.744184 11445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:26.747411 11435 server_base.cc:1034] running on GCE node
I20260810 03:49:26.748323 11435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:26.749888 11435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:26.751255 11435 hybrid_clock.cc:648] HybridClock initialized: now 1786333766751237 us; error 43 us; skew 500 ppm
I20260810 03:49:26.758005 11435 webserver.cc:460] Webserver started at http://127.22.134.254:39139/ using document root <none> and password file <none>
I20260810 03:49:26.758736 11435 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:26.758828 11435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:26.759078 11435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:26.761381 11435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "2823f5b99e0b47cdb5df62409bb1077a"
format_stamp: "Formatted at 2026-08-10 03:49:26 on dist-test-slave-qg60"
server_key: "e78b115eacb62450d72b34d3489e71c0"
server_key_iv: "69a2977156f26056473d6b7feed932dc"
server_key_version: "encryptionkey@0"
I20260810 03:49:26.761981 11435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "2823f5b99e0b47cdb5df62409bb1077a"
format_stamp: "Formatted at 2026-08-10 03:49:26 on dist-test-slave-qg60"
server_key: "e78b115eacb62450d72b34d3489e71c0"
server_key_iv: "69a2977156f26056473d6b7feed932dc"
server_key_version: "encryptionkey@0"
I20260810 03:49:26.766146 11435 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:26.768808 11451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:26.770255 11435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 03:49:26.770432 11435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "2823f5b99e0b47cdb5df62409bb1077a"
format_stamp: "Formatted at 2026-08-10 03:49:26 on dist-test-slave-qg60"
server_key: "e78b115eacb62450d72b34d3489e71c0"
server_key_iv: "69a2977156f26056473d6b7feed932dc"
server_key_version: "encryptionkey@0"
I20260810 03:49:26.770581 11435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:26.788144 11435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:26.789047 11435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:26.789258 11435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:26.796969 11435 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:32963
I20260810 03:49:26.796976 11510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:32963 every 8 connection(s)
I20260810 03:49:26.798046 11435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:26.801266 11511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:26.802209 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 11435
I20260810 03:49:26.802345 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:26.802699 23067 external_mini_cluster.cc:1428] Setting key cda13b74869c0e7afd011ef962b45bea
I20260810 03:49:26.807802 11511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a: Bootstrap starting.
I20260810 03:49:26.810554 11511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:26.811489 11511 log.cc:824] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:26.813149 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:26.804487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.22.134.254:32963)
0810 03:49:26.805178 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:26.805195 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:26.805233 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:49:26.805953 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:26.805974 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:26.806375 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:26.806682 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:26.807122 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.808278 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.809564 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:26.810070 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:26.810208 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:26.811155 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:26.811160 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:26.811173 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:26.811559 (+ 386us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:26.811655 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:26.811684 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:26.811771 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:26.811963 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 03:49:26.812260 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":172,"threads_started":1}
I20260810 03:49:26.813944 11511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a: No bootstrap required, opened a new log
I20260810 03:49:26.817799 11511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2823f5b99e0b47cdb5df62409bb1077a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32963 } }
I20260810 03:49:26.818060 11511 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:26.818136 11511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2823f5b99e0b47cdb5df62409bb1077a, State: Initialized, Role: FOLLOWER
I20260810 03:49:26.818581 11511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2823f5b99e0b47cdb5df62409bb1077a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32963 } }
I20260810 03:49:26.818734 11511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:26.818818 11511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:26.818938 11511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:26.820017 11511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2823f5b99e0b47cdb5df62409bb1077a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32963 } }
I20260810 03:49:26.820369 11511 leader_election.cc:302] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2823f5b99e0b47cdb5df62409bb1077a; no voters:
I20260810 03:49:26.820709 11511 leader_election.cc:288] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:26.820928 11516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:26.821194 11516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [term 1 LEADER]: Becoming Leader. State: Replica: 2823f5b99e0b47cdb5df62409bb1077a, State: Running, Role: LEADER
I20260810 03:49:26.821502 11516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2823f5b99e0b47cdb5df62409bb1077a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32963 } }
I20260810 03:49:26.822027 11511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:26.823150 11517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2823f5b99e0b47cdb5df62409bb1077a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2823f5b99e0b47cdb5df62409bb1077a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32963 } } }
I20260810 03:49:26.823287 11517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:26.823558 11518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2823f5b99e0b47cdb5df62409bb1077a. Latest consensus state: current_term: 1 leader_uuid: "2823f5b99e0b47cdb5df62409bb1077a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2823f5b99e0b47cdb5df62409bb1077a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 32963 } } }
I20260810 03:49:26.823657 11526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:26.823675 11518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:26.826898 11526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:26.832417 11526 catalog_manager.cc:1347] Generated new cluster ID: 42d27fe8743b4c8d8c6cac91a62653c5
I20260810 03:49:26.832508 11526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:26.845289 11526 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:26.846264 11526 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:26.854696 11526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a: Generated new TSK 0
I20260810 03:49:26.855481 11526 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:26.862787 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32963
--builtin_ntp_servers=127.22.134.212:44793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:49:26.979951 11537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:26.980230 11537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:26.980269 11537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:26.984411 11537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:26.984483 11537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:26.984539 11537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:49:26.989777 11537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:26.990938 11537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:26.992456 11537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:49:27.002854 11537 server_base.cc:1034] running on GCE node
W20260810 03:49:27.002765 11543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:27.002772 11544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:27.002774 11546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:27.003540 11537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:27.004317 11537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:27.005491 11537 hybrid_clock.cc:648] HybridClock initialized: now 1786333767005451 us; error 57 us; skew 500 ppm
I20260810 03:49:27.007658 11537 webserver.cc:460] Webserver started at http://127.22.134.193:39629/ using document root <none> and password file <none>
I20260810 03:49:27.008307 11537 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:27.008379 11537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:27.008644 11537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:27.011029 11537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "3b5a4f210bfd47a683ec3835a0fe26d8"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "00133c46c734014e1a3d111162acf88d"
server_key_iv: "5ab5309912a8e379908a2bef16177a6c"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.011633 11537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "3b5a4f210bfd47a683ec3835a0fe26d8"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "00133c46c734014e1a3d111162acf88d"
server_key_iv: "5ab5309912a8e379908a2bef16177a6c"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.015810 11537 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:49:27.018636 11554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.020151 11537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:49:27.020319 11537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "3b5a4f210bfd47a683ec3835a0fe26d8"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "00133c46c734014e1a3d111162acf88d"
server_key_iv: "5ab5309912a8e379908a2bef16177a6c"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.020452 11537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:27.042128 11537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:27.042917 11537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:27.043133 11537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:27.043776 11537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:27.044811 11537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:27.044896 11537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.044991 11537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:27.045039 11537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.055006 11537 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:43451
I20260810 03:49:27.055152 11680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:43451 every 8 connection(s)
I20260810 03:49:27.056010 11537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:49:27.060644 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 11537
I20260810 03:49:27.060820 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:49:27.061187 23067 external_mini_cluster.cc:1428] Setting key 2a39166ced1e2b6430173b3b4886d2a7
I20260810 03:49:27.063436 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32963
--builtin_ntp_servers=127.22.134.212:44793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:49:27.067041 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.058028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:43481 (local address 127.22.134.254:32963)
0810 03:49:27.058189 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.058194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.059355 (+ 1161us) server_negotiation.cc:407] Connection header received
0810 03:49:27.060866 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.060873 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.060944 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.061057 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:27.062219 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.062940 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.064802 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.065023 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.065225 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.066462 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:27.066466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:27.066468 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:27.066482 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:27.066506 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:27.066514 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:27.066588 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.066809 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.066884 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 03:49:27.067900 11684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.058474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32963 (local address 127.22.134.193:43481)
0810 03:49:27.059195 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.059251 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.060562 (+ 1311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.061209 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.061216 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.061350 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:27.062066 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.062083 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.063079 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.063083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.064617 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.064633 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.065294 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.065302 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.065499 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.066167 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:27.066169 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:27.066220 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:27.066291 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:27.066604 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:27.066620 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:27.066624 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.066737 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.067065 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":118,"threads_started":1}
I20260810 03:49:27.069240 11681 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32963
I20260810 03:49:27.069527 11681 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:27.070253 11681 heartbeater.cc:511] Master 127.22.134.254:32963 requested a full tablet report, sending...
I20260810 03:49:27.072003 11473 ts_manager.cc:194] Registered new tserver with Master: 3b5a4f210bfd47a683ec3835a0fe26d8 (127.22.134.193:43451)
I20260810 03:49:27.073359 11473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.193:43481
W20260810 03:49:27.180680 11685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:27.181020 11685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:27.181102 11685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:27.185262 11685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:27.185354 11685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:27.185447 11685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:49:27.190634 11685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:27.191813 11685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:27.193305 11685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:27.203225 11692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:27.203248 11695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:27.203248 11693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:27.203708 11685 server_base.cc:1034] running on GCE node
I20260810 03:49:27.204149 11685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:27.204890 11685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:27.206081 11685 hybrid_clock.cc:648] HybridClock initialized: now 1786333767206041 us; error 53 us; skew 500 ppm
I20260810 03:49:27.208109 11685 webserver.cc:460] Webserver started at http://127.22.134.194:37109/ using document root <none> and password file <none>
I20260810 03:49:27.208721 11685 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:27.208860 11685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:27.209110 11685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:27.211222 11685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "7aee9890e2b34213bbbbbdd30ec97801"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "f6e7bed429340641e92ace6cb89f4043"
server_key_iv: "7a48e0754b5bea752d1ddce847c14cfa"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.211797 11685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "7aee9890e2b34213bbbbbdd30ec97801"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "f6e7bed429340641e92ace6cb89f4043"
server_key_iv: "7a48e0754b5bea752d1ddce847c14cfa"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.215680 11685 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:49:27.218438 11702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.219836 11685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:49:27.220019 11685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "7aee9890e2b34213bbbbbdd30ec97801"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "f6e7bed429340641e92ace6cb89f4043"
server_key_iv: "7a48e0754b5bea752d1ddce847c14cfa"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.220144 11685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:27.250413 11685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:27.251178 11685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:27.251390 11685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:27.252007 11685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:27.253017 11685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:27.253087 11685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.253152 11685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:27.253192 11685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.263060 11685 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:43363
I20260810 03:49:27.263080 11841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:43363 every 8 connection(s)
I20260810 03:49:27.264074 11685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:49:27.272081 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 11685
I20260810 03:49:27.272229 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:49:27.272588 23067 external_mini_cluster.cc:1428] Setting key dccd94fe031e2c6bc300e44692b56a69
I20260810 03:49:27.273763 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.265977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:40329 (local address 127.22.134.254:32963)
0810 03:49:27.266153 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.266157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.267198 (+ 1041us) server_negotiation.cc:407] Connection header received
0810 03:49:27.268577 (+ 1379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.268581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.268629 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.268708 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:27.269782 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.270310 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.271458 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.271713 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.271826 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.273186 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:27.273190 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:27.273193 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:27.273209 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:27.273234 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:27.273248 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:27.273331 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.273520 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.273588 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 03:49:27.274868 11844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.266384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32963 (local address 127.22.134.194:40329)
0810 03:49:27.267051 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.267095 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.268386 (+ 1291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.268967 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.268978 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.269083 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:27.269641 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.269655 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.270417 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.270419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.271323 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.271332 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.271900 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.271905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.272120 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.272876 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:27.272878 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:27.272934 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:27.273013 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:27.273341 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:27.273351 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:27.273356 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.273484 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.273761 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":124,"threads_started":1}
I20260810 03:49:27.275056 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32963
--builtin_ntp_servers=127.22.134.212:44793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:49:27.276051 11842 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32963
I20260810 03:49:27.276296 11842 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:27.276901 11842 heartbeater.cc:511] Master 127.22.134.254:32963 requested a full tablet report, sending...
I20260810 03:49:27.278083 11473 ts_manager.cc:194] Registered new tserver with Master: 7aee9890e2b34213bbbbbdd30ec97801 (127.22.134.194:43363)
I20260810 03:49:27.278657 11473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.194:40329
W20260810 03:49:27.391289 11845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:27.391570 11845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:27.391607 11845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:27.395648 11845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:27.395710 11845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:27.395766 11845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:49:27.400491 11845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:44793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:32963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:27.401587 11845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:27.402917 11845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:27.412909 11855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:27.412961 11852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:27.412963 11851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:27.413044 11845 server_base.cc:1034] running on GCE node
I20260810 03:49:27.413709 11845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:27.414376 11845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:27.415544 11845 hybrid_clock.cc:648] HybridClock initialized: now 1786333767415516 us; error 41 us; skew 500 ppm
I20260810 03:49:27.417495 11845 webserver.cc:460] Webserver started at http://127.22.134.195:37027/ using document root <none> and password file <none>
I20260810 03:49:27.418085 11845 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:27.418152 11845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:27.418397 11845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:27.420465 11845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "50185c62ae7b4cfb8778b039ec833253"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "426c0b1601cc64385f04b6ade1e0d03d"
server_key_iv: "98ca1d924fba4da60ff8c7b2586cd73e"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.421105 11845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "50185c62ae7b4cfb8778b039ec833253"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "426c0b1601cc64385f04b6ade1e0d03d"
server_key_iv: "98ca1d924fba4da60ff8c7b2586cd73e"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.426287 11845 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 03:49:27.428956 11862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.430194 11845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:49:27.430333 11845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "50185c62ae7b4cfb8778b039ec833253"
format_stamp: "Formatted at 2026-08-10 03:49:27 on dist-test-slave-qg60"
server_key: "426c0b1601cc64385f04b6ade1e0d03d"
server_key_iv: "98ca1d924fba4da60ff8c7b2586cd73e"
server_key_version: "encryptionkey@0"
I20260810 03:49:27.430455 11845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:27.451493 11845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:27.452270 11845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:27.452477 11845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:27.453183 11845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:27.454164 11845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:27.454211 11845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.454274 11845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:27.454308 11845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:27.463227 11845 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:35579
I20260810 03:49:27.463248 11993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:35579 every 8 connection(s)
I20260810 03:49:27.464197 11845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:49:27.473853 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.466152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:43249 (local address 127.22.134.254:32963)
0810 03:49:27.466311 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.466315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.467468 (+ 1153us) server_negotiation.cc:407] Connection header received
0810 03:49:27.468892 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.468895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.468943 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.469031 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:27.469963 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.470494 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.471662 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.471882 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.471966 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.473416 (+ 1450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:27.473419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:27.473421 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:27.473434 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:27.473455 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:27.473463 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:27.473527 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.473669 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.473728 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:49:27.473975 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 11845
I20260810 03:49:27.474092 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:49:27.474429 23067 external_mini_cluster.cc:1428] Setting key 6846213c2be64e12752e9c87cbcafa17
I20260810 03:49:27.475140 11997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.466591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:32963 (local address 127.22.134.195:43249)
0810 03:49:27.467300 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.467344 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.468636 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.469201 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.469208 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.469291 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:27.469833 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.469846 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.470611 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.470614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.471526 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.471535 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.472105 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.472109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.472267 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.473143 (+ 876us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:27.473145 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:27.473188 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:27.473259 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:27.473542 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:27.473549 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:27.473553 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.473673 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.474115 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":122,"threads_started":1}
I20260810 03:49:27.476331 11994 heartbeater.cc:347] Connected to a master server at 127.22.134.254:32963
I20260810 03:49:27.476591 11994 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:27.477217 11994 heartbeater.cc:511] Master 127.22.134.254:32963 requested a full tablet report, sending...
I20260810 03:49:27.478298 11473 ts_manager.cc:194] Registered new tserver with Master: 50185c62ae7b4cfb8778b039ec833253 (127.22.134.195:35579)
I20260810 03:49:27.478842 11473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.195:43249
I20260810 03:49:27.489359 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:49:27.496462 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.491571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56750 (local address 127.22.134.254:32963)
0810 03:49:27.491766 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.491771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.491909 (+ 138us) server_negotiation.cc:407] Connection header received
0810 03:49:27.492203 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.492207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.492256 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.492387 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:27.492762 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.493350 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.494509 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.494757 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.494870 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.495934 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:27.495938 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:27.495940 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:27.495953 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:27.495974 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:27.495982 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:27.496122 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.496251 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.496295 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 03:49:27.500001 11473 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56750:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:49:27.503222 11473 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:49:27.518349 12007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.512344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:43451 (local address 127.0.0.1:55570)
0810 03:49:27.513281 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.513295 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.513367 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.514151 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.514154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.514174 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:27.514283 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.514290 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.515375 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.515379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.516623 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.516633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.517705 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.517708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.517832 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.517877 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.518025 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.518173 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"thread_start_us":86,"threads_started":1}
I20260810 03:49:27.518560 12011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.511989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:35579 (local address 127.0.0.1:60690)
0810 03:49:27.512875 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.512932 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.513063 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.513924 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.513930 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.513953 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:27.514135 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.514143 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.515682 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.515688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.517116 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.517128 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.518172 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.518176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.518261 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.518282 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.518345 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.518419 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":102,"thread_start_us":160,"threads_started":1}
I20260810 03:49:27.518688 12010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.512119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60690 (local address 127.22.134.195:35579)
0810 03:49:27.513428 (+ 1309us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.513441 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.513471 (+ 30us) server_negotiation.cc:407] Connection header received
0810 03:49:27.513556 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.513562 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.513765 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.513935 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:27.514281 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.515519 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.517252 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.518059 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.518186 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.518346 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.518397 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.518493 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1197,"thread_start_us":159,"threads_started":1}
I20260810 03:49:27.519063 12008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.512081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:43363 (local address 127.0.0.1:47364)
0810 03:49:27.513016 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.513032 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.513153 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.514265 (+ 1112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.514270 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.514287 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:27.514400 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.514407 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.515762 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.515765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.517117 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.517128 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.518287 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.518290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.518398 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.518431 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.518865 (+ 434us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.518934 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"mutex_wait_us":76,"thread_start_us":106,"threads_started":1}
I20260810 03:49:27.519091 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.513344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55570 (local address 127.22.134.193:43451)
0810 03:49:27.513692 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.513703 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.513724 (+ 21us) server_negotiation.cc:407] Connection header received
0810 03:49:27.513786 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.513790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.513953 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.514154 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:27.514401 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.515263 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.516783 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.517570 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.517701 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.517895 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.518816 (+ 921us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.518930 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":136,"threads_started":1}
I20260810 03:49:27.520385 12012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.512928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47364 (local address 127.22.134.194:43363)
0810 03:49:27.513647 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.513658 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.513681 (+ 23us) server_negotiation.cc:407] Connection header received
0810 03:49:27.513762 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.513767 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.513954 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.514108 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:27.514532 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.515643 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.517291 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.517951 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.518064 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.518223 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.520121 (+ 1898us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.520231 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":144,"threads_started":1}
I20260810 03:49:27.522163 11921 tablet_service.cc:1467] Processing CreateTablet for tablet baa84e3c2a514a38801ed4701855a219 (DEFAULT_TABLE table=test-table [id=542e542ad5444074a2f1daebd4feb54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:27.522167 11611 tablet_service.cc:1467] Processing CreateTablet for tablet baa84e3c2a514a38801ed4701855a219 (DEFAULT_TABLE table=test-table [id=542e542ad5444074a2f1daebd4feb54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:27.523330 11921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa84e3c2a514a38801ed4701855a219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:27.523329 11611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa84e3c2a514a38801ed4701855a219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:27.523133 11761 tablet_service.cc:1467] Processing CreateTablet for tablet baa84e3c2a514a38801ed4701855a219 (DEFAULT_TABLE table=test-table [id=542e542ad5444074a2f1daebd4feb54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:27.524051 11761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa84e3c2a514a38801ed4701855a219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:27.531203 12015 tablet_bootstrap.cc:492] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Bootstrap starting.
I20260810 03:49:27.533119 12016 tablet_bootstrap.cc:492] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8: Bootstrap starting.
I20260810 03:49:27.533119 12017 tablet_bootstrap.cc:492] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Bootstrap starting.
I20260810 03:49:27.534061 12015 tablet_bootstrap.cc:654] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:27.535373 12015 log.cc:824] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:27.535651 12016 tablet_bootstrap.cc:654] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:27.535969 12017 tablet_bootstrap.cc:654] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:27.536636 12016 log.cc:824] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:27.536831 12017 log.cc:824] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:27.537760 12015 tablet_bootstrap.cc:492] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: No bootstrap required, opened a new log
I20260810 03:49:27.537990 12015 ts_tablet_manager.cc:1397] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 03:49:27.538797 12017 tablet_bootstrap.cc:492] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: No bootstrap required, opened a new log
I20260810 03:49:27.538996 12016 tablet_bootstrap.cc:492] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8: No bootstrap required, opened a new log
I20260810 03:49:27.539034 12017 ts_tablet_manager.cc:1397] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:49:27.539209 12016 ts_tablet_manager.cc:1397] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 03:49:27.543875 12016 raft_consensus.cc:348] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.543965 12015 raft_consensus.cc:348] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.544216 12016 raft_consensus.cc:374] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:27.543965 12017 raft_consensus.cc:348] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.544272 12016 raft_consensus.cc:729] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b5a4f210bfd47a683ec3835a0fe26d8, State: Initialized, Role: FOLLOWER
I20260810 03:49:27.544265 12015 raft_consensus.cc:374] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:27.544304 12017 raft_consensus.cc:374] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:27.544337 12015 raft_consensus.cc:729] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50185c62ae7b4cfb8778b039ec833253, State: Initialized, Role: FOLLOWER
I20260810 03:49:27.544356 12017 raft_consensus.cc:729] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aee9890e2b34213bbbbbdd30ec97801, State: Initialized, Role: FOLLOWER
I20260810 03:49:27.544862 12016 consensus_queue.cc:260] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.544867 12015 consensus_queue.cc:260] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.544867 12017 consensus_queue.cc:260] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.545881 12016 ts_tablet_manager.cc:1428] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 03:49:27.545933 12015 ts_tablet_manager.cc:1428] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Time spent starting tablet: real 0.008s user 0.005s sys 0.003s
I20260810 03:49:27.545938 12017 ts_tablet_manager.cc:1428] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 03:49:27.546447 11994 heartbeater.cc:503] Master 127.22.134.254:32963 was elected leader, sending a full tablet report...
I20260810 03:49:27.546527 11842 heartbeater.cc:503] Master 127.22.134.254:32963 was elected leader, sending a full tablet report...
I20260810 03:49:27.547395 11681 heartbeater.cc:503] Master 127.22.134.254:32963 was elected leader, sending a full tablet report...
W20260810 03:49:27.557289 11683 tablet.cc:2369] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:49:27.715358 11995 tablet.cc:2369] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:49:27.765364 11843 tablet.cc:2369] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:49:27.853567 12021 raft_consensus.cc:482] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:27.853766 12023 raft_consensus.cc:482] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:27.853863 12021 raft_consensus.cc:504] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.854002 12023 raft_consensus.cc:504] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.855968 12023 leader_election.cc:288] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50185c62ae7b4cfb8778b039ec833253 (127.22.134.195:35579), 7aee9890e2b34213bbbbbdd30ec97801 (127.22.134.194:43363)
I20260810 03:49:27.855979 12021 leader_election.cc:288] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50185c62ae7b4cfb8778b039ec833253 (127.22.134.195:35579), 3b5a4f210bfd47a683ec3835a0fe26d8 (127.22.134.193:43451)
I20260810 03:49:27.860708 12012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.855796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:52961 (local address 127.22.134.194:43363)
0810 03:49:27.855908 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.855915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.855932 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:49:27.856132 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.856136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.856193 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.856244 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:27.856865 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.857675 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.859330 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.859954 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.860080 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.860134 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.860523 (+ 389us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.860602 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":40,"spinlock_wait_cycles":11520}
I20260810 03:49:27.860708 12010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.856024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:36723 (local address 127.22.134.195:35579)
0810 03:49:27.856277 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.856283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.856301 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:49:27.856476 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.856480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.856533 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.856581 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:27.857033 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.857794 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.859330 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.859906 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.860010 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.860067 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.860454 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.860556 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":160}
I20260810 03:49:27.861222 12030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.855440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:35579 (local address 127.22.134.194:36723)
0810 03:49:27.856226 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.856241 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.856324 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.856714 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.856717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.856764 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:27.856911 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.856918 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.857922 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.857925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.859176 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.859188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.860195 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.860202 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.860295 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.860317 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.860996 (+ 679us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.861073 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"spinlock_wait_cycles":24448,"thread_start_us":109,"threads_started":1}
I20260810 03:49:27.861265 12029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.855440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:43363 (local address 127.22.134.193:52961)
0810 03:49:27.855848 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.855867 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.855991 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.856522 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.856526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.856545 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:27.856708 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.856716 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.857824 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.857830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.859176 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.859188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.860259 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.860263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.860368 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.860405 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.861045 (+ 640us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.861119 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":100,"threads_started":1}
I20260810 03:49:27.861812 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.855606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:37641 (local address 127.22.134.193:43451)
0810 03:49:27.855938 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.855945 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.856765 (+ 820us) server_negotiation.cc:407] Connection header received
0810 03:49:27.856981 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.856984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.857044 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.857100 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:27.857608 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.858435 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.860373 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.861055 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.861153 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.861195 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.861594 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.861679 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"spinlock_wait_cycles":2304}
I20260810 03:49:27.861974 11784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa84e3c2a514a38801ed4701855a219" candidate_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aee9890e2b34213bbbbbdd30ec97801" is_pre_election: true
I20260810 03:49:27.861976 11945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa84e3c2a514a38801ed4701855a219" candidate_uuid: "7aee9890e2b34213bbbbbdd30ec97801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50185c62ae7b4cfb8778b039ec833253" is_pre_election: true
I20260810 03:49:27.862252 12031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.856144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:44073 (local address 127.22.134.195:35579)
0810 03:49:27.856473 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.856483 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.856772 (+ 289us) server_negotiation.cc:407] Connection header received
0810 03:49:27.856825 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.856828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.856875 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.856963 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:27.857488 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.858422 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.860099 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.860997 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.861135 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.861179 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.861990 (+ 811us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.862070 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":132,"server-negotiator.queue_time_us":268,"thread_start_us":95,"threads_started":1}
I20260810 03:49:27.862233 11784 raft_consensus.cc:2454] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b5a4f210bfd47a683ec3835a0fe26d8 in term 0.
I20260810 03:49:27.862252 12027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.855441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:43451 (local address 127.22.134.194:37641)
0810 03:49:27.856653 (+ 1212us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.856670 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.856845 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.857303 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.857308 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.857329 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:27.857464 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.857474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.858585 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.858588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.860236 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.860244 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.861302 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.861307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.861445 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.861468 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.862036 (+ 568us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.862109 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1145,"mutex_wait_us":214,"thread_start_us":60,"threads_started":1}
I20260810 03:49:27.861856 12026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.855448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:35579 (local address 127.22.134.193:44073)
0810 03:49:27.856474 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.856506 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:27.856639 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:27.857084 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:27.857091 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:27.857106 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:27.857345 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.857353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.858583 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.858586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.859940 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:27.859952 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.861257 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.861260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:27.861552 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.861585 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 03:49:27.861654 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 03:49:27.861711 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":961,"mutex_wait_us":3,"spinlock_wait_cycles":201984,"thread_start_us":150,"threads_started":1}
I20260810 03:49:27.862286 11945 raft_consensus.cc:2454] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aee9890e2b34213bbbbbdd30ec97801 in term 0.
I20260810 03:49:27.862802 11557 leader_election.cc:302] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b5a4f210bfd47a683ec3835a0fe26d8, 7aee9890e2b34213bbbbbdd30ec97801; no voters:
I20260810 03:49:27.863148 12023 raft_consensus.cc:2781] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:49:27.863149 11632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa84e3c2a514a38801ed4701855a219" candidate_uuid: "7aee9890e2b34213bbbbbdd30ec97801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" is_pre_election: true
I20260810 03:49:27.863251 11703 leader_election.cc:302] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50185c62ae7b4cfb8778b039ec833253, 7aee9890e2b34213bbbbbdd30ec97801; no voters:
I20260810 03:49:27.863322 12023 raft_consensus.cc:482] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:49:27.863380 12023 raft_consensus.cc:3037] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:27.863535 11945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa84e3c2a514a38801ed4701855a219" candidate_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50185c62ae7b4cfb8778b039ec833253" is_pre_election: true
I20260810 03:49:27.863557 12021 raft_consensus.cc:2781] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:49:27.863653 12021 raft_consensus.cc:482] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:49:27.863711 12021 raft_consensus.cc:3037] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:27.863691 11945 raft_consensus.cc:2454] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b5a4f210bfd47a683ec3835a0fe26d8 in term 0.
I20260810 03:49:27.864934 12023 raft_consensus.cc:504] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.865096 12021 raft_consensus.cc:504] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.865284 11632 raft_consensus.cc:2379] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7aee9890e2b34213bbbbbdd30ec97801 in current term 1: Already voted for candidate 3b5a4f210bfd47a683ec3835a0fe26d8 in this term.
I20260810 03:49:27.865406 12023 leader_election.cc:288] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [CANDIDATE]: Term 1 election: Requested vote from peers 50185c62ae7b4cfb8778b039ec833253 (127.22.134.195:35579), 7aee9890e2b34213bbbbbdd30ec97801 (127.22.134.194:43363)
I20260810 03:49:27.865826 11631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa84e3c2a514a38801ed4701855a219" candidate_uuid: "7aee9890e2b34213bbbbbdd30ec97801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8"
I20260810 03:49:27.865891 11944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa84e3c2a514a38801ed4701855a219" candidate_uuid: "7aee9890e2b34213bbbbbdd30ec97801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50185c62ae7b4cfb8778b039ec833253"
I20260810 03:49:27.866008 11944 raft_consensus.cc:3037] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:27.866109 12021 leader_election.cc:288] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [CANDIDATE]: Term 1 election: Requested vote from peers 50185c62ae7b4cfb8778b039ec833253 (127.22.134.195:35579), 3b5a4f210bfd47a683ec3835a0fe26d8 (127.22.134.193:43451)
I20260810 03:49:27.866209 11784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa84e3c2a514a38801ed4701855a219" candidate_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aee9890e2b34213bbbbbdd30ec97801"
I20260810 03:49:27.866282 11945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baa84e3c2a514a38801ed4701855a219" candidate_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50185c62ae7b4cfb8778b039ec833253"
I20260810 03:49:27.866366 11784 raft_consensus.cc:2379] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b5a4f210bfd47a683ec3835a0fe26d8 in current term 1: Already voted for candidate 7aee9890e2b34213bbbbbdd30ec97801 in this term.
I20260810 03:49:27.866909 11555 leader_election.cc:302] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b5a4f210bfd47a683ec3835a0fe26d8; no voters: 50185c62ae7b4cfb8778b039ec833253, 7aee9890e2b34213bbbbbdd30ec97801
I20260810 03:49:27.867133 12023 raft_consensus.cc:2726] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 03:49:27.867406 11944 raft_consensus.cc:2454] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aee9890e2b34213bbbbbdd30ec97801 in term 1.
I20260810 03:49:27.867688 11703 leader_election.cc:302] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50185c62ae7b4cfb8778b039ec833253, 7aee9890e2b34213bbbbbdd30ec97801; no voters: 3b5a4f210bfd47a683ec3835a0fe26d8
I20260810 03:49:27.867871 12021 raft_consensus.cc:2781] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:27.868175 12021 raft_consensus.cc:686] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 1 LEADER]: Becoming Leader. State: Replica: 7aee9890e2b34213bbbbbdd30ec97801, State: Running, Role: LEADER
I20260810 03:49:27.868594 12021 consensus_queue.cc:237] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } }
I20260810 03:49:27.871968 11473 catalog_manager.cc:5495] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aee9890e2b34213bbbbbdd30ec97801 (127.22.134.194). New cstate: current_term: 1 leader_uuid: "7aee9890e2b34213bbbbbdd30ec97801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aee9890e2b34213bbbbbdd30ec97801" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 43363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 } health_report { overall_health: UNKNOWN } } }
I20260810 03:49:27.893774 12012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.889971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47366 (local address 127.22.134.194:43363)
0810 03:49:27.890106 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:27.890109 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:27.890124 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:49:27.890196 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:27.890198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:27.890251 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:27.890340 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:49:27.890638 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.891220 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.892223 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:27.892441 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:27.892524 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:27.892917 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:49:27.893331 (+ 414us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:49:27.893445 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:27.893539 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 03:49:27.893572 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:49:27.900115 11631 raft_consensus.cc:1261] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 1 FOLLOWER]: Refusing update from remote peer 7aee9890e2b34213bbbbbdd30ec97801: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:27.900164 11944 raft_consensus.cc:1261] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 1 FOLLOWER]: Refusing update from remote peer 7aee9890e2b34213bbbbbdd30ec97801: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:27.900775 12021 consensus_queue.cc:1035] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50185c62ae7b4cfb8778b039ec833253" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 35579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:27.900981 12032 consensus_queue.cc:1035] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b5a4f210bfd47a683ec3835a0fe26d8" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 43451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:27.917119 11471 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:27.917351 11471 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:27.920084 11471 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2823f5b99e0b47cdb5df62409bb1077a: Sending DeleteTablet for 3 replicas of tablet baa84e3c2a514a38801ed4701855a219
I20260810 03:49:27.921041 11921 tablet_service.cc:1514] Processing DeleteTablet for tablet baa84e3c2a514a38801ed4701855a219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:27 UTC) from {username='slave'} at 127.0.0.1:60690
I20260810 03:49:27.921607 12046 tablet_replica.cc:330] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: stopping tablet replica
I20260810 03:49:27.921662 11611 tablet_service.cc:1514] Processing DeleteTablet for tablet baa84e3c2a514a38801ed4701855a219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:27 UTC) from {username='slave'} at 127.0.0.1:55570
I20260810 03:49:27.922024 12046 raft_consensus.cc:2229] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:27.922312 12047 tablet_replica.cc:330] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8: stopping tablet replica
I20260810 03:49:27.922464 11761 tablet_service.cc:1514] Processing DeleteTablet for tablet baa84e3c2a514a38801ed4701855a219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:27 UTC) from {username='slave'} at 127.0.0.1:47364
I20260810 03:49:27.922780 12047 raft_consensus.cc:2229] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:27.922868 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 11537
I20260810 03:49:27.923203 12047 raft_consensus.cc:2258] T baa84e3c2a514a38801ed4701855a219 P 3b5a4f210bfd47a683ec3835a0fe26d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:27.925211 12046 raft_consensus.cc:2258] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:27.925628 12048 tablet_replica.cc:330] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: stopping tablet replica
I20260810 03:49:27.925925 12048 raft_consensus.cc:2229] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:49:27.926301 12048 raft_consensus.cc:2258] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:27.927305 12046 ts_tablet_manager.cc:1905] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:27.927740 12048 ts_tablet_manager.cc:1905] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:27.929865 12046 ts_tablet_manager.cc:1918] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:27.929993 12046 log.cc:1196] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/baa84e3c2a514a38801ed4701855a219
I20260810 03:49:27.930286 12046 ts_tablet_manager.cc:1939] T baa84e3c2a514a38801ed4701855a219 P 50185c62ae7b4cfb8778b039ec833253: Deleting consensus metadata
I20260810 03:49:27.931317 12048 ts_tablet_manager.cc:1918] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:27.931423 12048 log.cc:1196] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/baa84e3c2a514a38801ed4701855a219
I20260810 03:49:27.931597 11453 catalog_manager.cc:4841] TS 50185c62ae7b4cfb8778b039ec833253 (127.22.134.195:35579): tablet baa84e3c2a514a38801ed4701855a219 (table test-table [id=542e542ad5444074a2f1daebd4feb54b]) successfully deleted
I20260810 03:49:27.931746 12048 ts_tablet_manager.cc:1939] T baa84e3c2a514a38801ed4701855a219 P 7aee9890e2b34213bbbbbdd30ec97801: Deleting consensus metadata
I20260810 03:49:27.933252 11454 catalog_manager.cc:4841] TS 7aee9890e2b34213bbbbbdd30ec97801 (127.22.134.194:43363): tablet baa84e3c2a514a38801ed4701855a219 (table test-table [id=542e542ad5444074a2f1daebd4feb54b]) successfully deleted
W20260810 03:49:27.933723 11457 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:43451 (error 108)
I20260810 03:49:27.934046 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 11685
I20260810 03:49:27.936221 12008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:27.935810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:43451 (local address 127.0.0.1:55580)
0810 03:49:27.935997 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:27.936102 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:43451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260810 03:49:27.936522 11457 catalog_manager.cc:4584] TS 3b5a4f210bfd47a683ec3835a0fe26d8 (127.22.134.193:43451): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet baa84e3c2a514a38801ed4701855a219: Network error: Client connection negotiation failed: client connection to 127.22.134.193:43451: connect: Connection refused (error 111)
I20260810 03:49:27.942101 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 11845
I20260810 03:49:27.950852 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 11435
2026-08-10T03:49:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1379 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:28 dist-test-slave-qg60 krb5kdc[12052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:28 dist-test-slave-qg60 krb5kdc[12052](info): set up 2 sockets
Aug 10 03:49:28 dist-test-slave-qg60 krb5kdc[12052](info): commencing operation
krb5kdc: starting...
W20260810 03:49:29.085193 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:29 dist-test-slave-qg60 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:29.222299 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:37377
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:46509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:37377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:29.338605 12065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:29.338925 12065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:29.339002 12065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:29.343050 12065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:29.343155 12065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:29.343194 12065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:29.343232 12065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:29.343264 12065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:29.348654 12065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:46509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:37377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:37377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:29.349898 12065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:29.350965 12065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:49:29.360195 12065 server_base.cc:1034] running on GCE node
W20260810 03:49:29.360144 12075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:29.360371 12071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:29.360144 12072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:29.361136 12065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:29.362285 12065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:29.363482 12065 hybrid_clock.cc:648] HybridClock initialized: now 1786333769363468 us; error 35 us; skew 500 ppm
Aug 10 03:49:29 dist-test-slave-qg60 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333769, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:29.366382 12065 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:29.367336 12065 webserver.cc:460] Webserver started at http://127.22.134.254:46415/ using document root <none> and password file <none>
I20260810 03:49:29.367921 12065 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:29.368014 12065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:29.368278 12065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:29.370496 12065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "d73cefd79d80440a99277783b48057c6"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "8e089958465b883dbd883b4639ff9f99"
server_key_iv: "4206d649b99b99bef7d08160eb995268"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.371131 12065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "d73cefd79d80440a99277783b48057c6"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "8e089958465b883dbd883b4639ff9f99"
server_key_iv: "4206d649b99b99bef7d08160eb995268"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.375020 12065 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:29.377579 12083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:29.378855 12065 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:49:29.379007 12065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "d73cefd79d80440a99277783b48057c6"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "8e089958465b883dbd883b4639ff9f99"
server_key_iv: "4206d649b99b99bef7d08160eb995268"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.379128 12065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:29.391870 12065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:29.394892 12065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:29.395108 12065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:29.402920 12065 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:37377
I20260810 03:49:29.402947 12144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:37377 every 8 connection(s)
I20260810 03:49:29.403906 12065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:29.407037 12145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:29.410065 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 12065
I20260810 03:49:29.410213 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:29.410490 23067 external_mini_cluster.cc:1428] Setting key a422b3726c71a21797a2116c13d5b5b3
I20260810 03:49:29.413167 12145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6: Bootstrap starting.
I20260810 03:49:29.415964 12145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:29.416893 12145 log.cc:824] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:29.419175 12145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6: No bootstrap required, opened a new log
Aug 10 03:49:29 dist-test-slave-qg60 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:29.422816 12145 raft_consensus.cc:348] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73cefd79d80440a99277783b48057c6" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37377 } }
I20260810 03:49:29.423084 12145 raft_consensus.cc:374] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:29.423174 12145 raft_consensus.cc:729] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d73cefd79d80440a99277783b48057c6, State: Initialized, Role: FOLLOWER
I20260810 03:49:29.423677 12145 consensus_queue.cc:260] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73cefd79d80440a99277783b48057c6" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37377 } }
I20260810 03:49:29.423837 12145 raft_consensus.cc:388] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:29.423921 12145 raft_consensus.cc:482] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:29.424021 12145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:29.425334 12145 raft_consensus.cc:504] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73cefd79d80440a99277783b48057c6" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37377 } }
I20260810 03:49:29.425689 12145 leader_election.cc:302] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d73cefd79d80440a99277783b48057c6; no voters:
I20260810 03:49:29.426050 12145 leader_election.cc:288] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:29.426215 12150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:29.426434 12150 raft_consensus.cc:686] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [term 1 LEADER]: Becoming Leader. State: Replica: d73cefd79d80440a99277783b48057c6, State: Running, Role: LEADER
I20260810 03:49:29.426774 12150 consensus_queue.cc:237] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73cefd79d80440a99277783b48057c6" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37377 } }
I20260810 03:49:29.427446 12145 sys_catalog.cc:564] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:29.427783 12148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:29.411970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33056 (local address 127.22.134.254:37377)
0810 03:49:29.412428 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:29.412447 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:29.412489 (+ 42us) server_negotiation.cc:407] Connection header received
0810 03:49:29.413399 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:29.413421 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:29.413828 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:29.414217 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:29.414975 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.416479 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.417618 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.418406 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.418573 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:29.421562 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:29.421568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:29.421583 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:29.421611 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:29.424161 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:29.424695 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:29.424700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:29.424705 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:29.424892 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:29.425212 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:29.425215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:29.425216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:29.425712 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:29.425917 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:29.426374 (+ 457us) server_negotiation.cc:299] Negotiation successful
0810 03:49:29.426791 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":123,"threads_started":1}
I20260810 03:49:29.428665 12152 sys_catalog.cc:455] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d73cefd79d80440a99277783b48057c6. Latest consensus state: current_term: 1 leader_uuid: "d73cefd79d80440a99277783b48057c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73cefd79d80440a99277783b48057c6" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37377 } } }
I20260810 03:49:29.429194 12152 sys_catalog.cc:458] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:29.429083 12151 sys_catalog.cc:455] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d73cefd79d80440a99277783b48057c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d73cefd79d80440a99277783b48057c6" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 37377 } } }
I20260810 03:49:29.431998 12151 sys_catalog.cc:458] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6 [sys.catalog]: This master's current role is: LEADER
W20260810 03:49:29.433089 12166 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:49:29.433174 12166 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:49:29.433255 12161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:29.433995 12161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:29.441792 12161 catalog_manager.cc:1347] Generated new cluster ID: 62d9c819acc44376a25532a0461ef1e0
I20260810 03:49:29.441886 12161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:29.451349 12161 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:29.452363 12161 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:29.461673 12161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6: Generated new TSK 0
I20260810 03:49:29.462459 12161 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.134.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
Entry for principal kudu/127.22.134.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab.
I20260810 03:49:29.496850 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37377
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:46509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:29.614286 12172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:29.614576 12172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:29.614622 12172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:29.618784 12172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:29.618860 12172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:29.618952 12172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:49:29.624477 12172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:46509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.193.keytab
--principal=kudu/127.22.134.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:29.625653 12172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:29.626731 12172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:29.637117 12179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:29.637185 12178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:29.637293 12172 server_base.cc:1034] running on GCE node
W20260810 03:49:29.637483 12181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:29.637907 12172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:29.638600 12172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:29.639763 12172 hybrid_clock.cc:648] HybridClock initialized: now 1786333769639741 us; error 38 us; skew 500 ppm
Aug 10 03:49:29 dist-test-slave-qg60 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333769, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:29.642757 12172 init.cc:377] Logged in from keytab as kudu/127.22.134.193@KRBTEST.COM (short username kudu)
I20260810 03:49:29.643774 12172 webserver.cc:460] Webserver started at http://127.22.134.193:39391/ using document root <none> and password file <none>
I20260810 03:49:29.644366 12172 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:29.644429 12172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:29.644673 12172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:29.646889 12172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "eac0dde85b6749839512f1f0b502da0d"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "fd5628bc138f620a8b3ebe5382c6b991"
server_key_iv: "b668f876680721acff83687fabea958a"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.647485 12172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "eac0dde85b6749839512f1f0b502da0d"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "fd5628bc138f620a8b3ebe5382c6b991"
server_key_iv: "b668f876680721acff83687fabea958a"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.651810 12172 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:49:29.654724 12190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:29.656016 12172 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:49:29.656165 12172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "eac0dde85b6749839512f1f0b502da0d"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "fd5628bc138f620a8b3ebe5382c6b991"
server_key_iv: "b668f876680721acff83687fabea958a"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.656293 12172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:29.682578 12172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:29.686419 12172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:29.686669 12172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:29.687373 12172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:29.688390 12172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:29.688467 12172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:29.688541 12172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:29.688596 12172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:29.698724 12172 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:45089
I20260810 03:49:29.698746 12326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:45089 every 8 connection(s)
I20260810 03:49:29.699783 12172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:49:29.705202 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 12172
I20260810 03:49:29.705379 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:49:29.705744 23067 external_mini_cluster.cc:1428] Setting key d77c029639a54820a1149479a8ec93bb
Aug 10 03:49:29 dist-test-slave-qg60 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333769, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.193@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.194@KRBTEST.COM; defaulting to no policy
I20260810 03:49:29.716420 12148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:29.701776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:33253 (local address 127.22.134.254:37377)
0810 03:49:29.701944 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:29.701949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:29.702890 (+ 941us) server_negotiation.cc:407] Connection header received
0810 03:49:29.704365 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:29.704368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:29.704422 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:29.704509 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:29.706336 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.707104 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.709106 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.709347 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.709449 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:29.712470 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:29.712474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:29.712476 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:29.712504 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:29.714203 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:29.714785 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:29.714789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:29.714791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:29.714877 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:29.715242 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:29.715247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:29.715249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:29.715455 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:29.715567 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:29.716098 (+ 531us) server_negotiation.cc:299] Negotiation successful
0810 03:49:29.716246 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:49:29.717470 12329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:29.702175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37377 (local address 127.22.134.193:33253)
0810 03:49:29.702713 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:29.702761 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:29.704139 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:29.704682 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:29.704689 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:29.705375 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:29.706151 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:29.706176 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.707264 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.707268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:29.708910 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:29.708927 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.709533 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.709541 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:29.709813 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:29.710540 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:29.710558 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:29.712228 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:29.714355 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:29.714361 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:29.714380 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:29.714674 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:29.714980 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:29.714983 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:29.714985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:29.715145 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:29.715570 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:29.715580 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:29.715858 (+ 278us) client_negotiation.cc:769] Sending connection context
0810 03:49:29.716066 (+ 208us) client_negotiation.cc:240] Negotiation successful
0810 03:49:29.716437 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":144,"threads_started":1}
I20260810 03:49:29.718950 12327 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37377
I20260810 03:49:29.719235 12327 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.194@KRBTEST.COM" created.
I20260810 03:49:29.719862 12327 heartbeater.cc:511] Master 127.22.134.254:37377 requested a full tablet report, sending...
I20260810 03:49:29.721776 12103 ts_manager.cc:194] Registered new tserver with Master: eac0dde85b6749839512f1f0b502da0d (127.22.134.193:45089)
I20260810 03:49:29.722915 12103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.193@KRBTEST.COM'} at 127.22.134.193:33253
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
Entry for principal kudu/127.22.134.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab.
I20260810 03:49:29.740710 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37377
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:46509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:29.856108 12334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:29.856437 12334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:29.856515 12334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:29.860685 12334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:29.860797 12334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:29.860889 12334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:49:29.866595 12334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:46509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.194.keytab
--principal=kudu/127.22.134.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:29.867749 12334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:29.868862 12334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:29.879484 12344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:29.879439 12340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:29.879446 12339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:29.879951 12334 server_base.cc:1034] running on GCE node
I20260810 03:49:29.880334 12334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:29.881138 12334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:29.882319 12334 hybrid_clock.cc:648] HybridClock initialized: now 1786333769882298 us; error 34 us; skew 500 ppm
Aug 10 03:49:29 dist-test-slave-qg60 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333769, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:29.885672 12334 init.cc:377] Logged in from keytab as kudu/127.22.134.194@KRBTEST.COM (short username kudu)
I20260810 03:49:29.886814 12334 webserver.cc:460] Webserver started at http://127.22.134.194:45141/ using document root <none> and password file <none>
I20260810 03:49:29.887467 12334 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:29.887538 12334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:29.887825 12334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:29.890307 12334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "820e959447a347e38f18a3f5c332d6f1"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "4bd21cb4d4fee6b9855a0d8832376feb"
server_key_iv: "34cdbba2eceff894287e0baad110c70f"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.890951 12334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "820e959447a347e38f18a3f5c332d6f1"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "4bd21cb4d4fee6b9855a0d8832376feb"
server_key_iv: "34cdbba2eceff894287e0baad110c70f"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.895282 12334 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:29.898226 12351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:29.899739 12334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:49:29.899866 12334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "820e959447a347e38f18a3f5c332d6f1"
format_stamp: "Formatted at 2026-08-10 03:49:29 on dist-test-slave-qg60"
server_key: "4bd21cb4d4fee6b9855a0d8832376feb"
server_key_iv: "34cdbba2eceff894287e0baad110c70f"
server_key_version: "encryptionkey@0"
I20260810 03:49:29.899997 12334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:29.914362 12334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:29.917896 12334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:29.918126 12334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:29.918771 12334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:29.919922 12334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:29.919987 12334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:29.920050 12334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:29.920073 12334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:29.930053 12334 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:36933
I20260810 03:49:29.930070 12481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:36933 every 8 connection(s)
I20260810 03:49:29.930997 12334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:49:29.938853 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 12334
I20260810 03:49:29.938985 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:49:29.939299 23067 external_mini_cluster.cc:1428] Setting key 61f8369efed4cc93af7027a2181d45c1
Aug 10 03:49:29 dist-test-slave-qg60 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333769, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.194@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:29.946890 12148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:29.933110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:42491 (local address 127.22.134.254:37377)
0810 03:49:29.933247 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:29.933251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:29.934142 (+ 891us) server_negotiation.cc:407] Connection header received
0810 03:49:29.935698 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:29.935702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:29.935771 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:29.935885 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:29.937251 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.937856 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.939235 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.939559 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.939679 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:29.942579 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:29.942583 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:29.942586 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:29.942621 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:29.944255 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:29.945005 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:29.945008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:29.945009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:29.945101 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:29.945563 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:29.945565 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:29.945566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:29.945770 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:29.945852 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:29.946646 (+ 794us) server_negotiation.cc:299] Negotiation successful
0810 03:49:29.946762 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:49:29.948019 12486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:29.933443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37377 (local address 127.22.134.194:42491)
0810 03:49:29.933950 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:29.934001 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:29.935420 (+ 1419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:29.936074 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:29.936082 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:29.936495 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:29.937087 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:29.937103 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.938000 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.938004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:29.939089 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:29.939100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:29.939744 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:29.939749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:29.939944 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:29.940626 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:29.940657 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:29.942381 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:29.944394 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:29.944406 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:29.944428 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:29.944892 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:29.945213 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:29.945220 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:29.945225 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:29.945441 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:29.945883 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:29.945894 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:29.946315 (+ 421us) client_negotiation.cc:769] Sending connection context
0810 03:49:29.946582 (+ 267us) client_negotiation.cc:240] Negotiation successful
0810 03:49:29.947009 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":130,"threads_started":1}
I20260810 03:49:29.949467 12484 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37377
I20260810 03:49:29.949771 12484 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:29.950457 12484 heartbeater.cc:511] Master 127.22.134.254:37377 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.134.195@KRBTEST.COM; defaulting to no policy
I20260810 03:49:29.951740 12103 ts_manager.cc:194] Registered new tserver with Master: 820e959447a347e38f18a3f5c332d6f1 (127.22.134.194:36933)
I20260810 03:49:29.952638 12103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.194@KRBTEST.COM'} at 127.22.134.194:42491
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
Entry for principal kudu/127.22.134.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab.
I20260810 03:49:29.973178 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37377
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:46509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:30.093062 12489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:30.093339 12489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:30.093384 12489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:30.097580 12489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:30.097651 12489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:30.097710 12489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:49:30.103572 12489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:46509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.195.keytab
--principal=kudu/127.22.134.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:37377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:30.105012 12489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:30.106067 12489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:30.116283 12498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:30.116240 12494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:30.116240 12495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:30.116776 12489 server_base.cc:1034] running on GCE node
I20260810 03:49:30.117290 12489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:30.117976 12489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:30.119211 12489 hybrid_clock.cc:648] HybridClock initialized: now 1786333770119176 us; error 47 us; skew 500 ppm
Aug 10 03:49:30 dist-test-slave-qg60 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:30.122362 12489 init.cc:377] Logged in from keytab as kudu/127.22.134.195@KRBTEST.COM (short username kudu)
I20260810 03:49:30.123276 12489 webserver.cc:460] Webserver started at http://127.22.134.195:41803/ using document root <none> and password file <none>
I20260810 03:49:30.123865 12489 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:30.123957 12489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:30.124202 12489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:30.126387 12489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "9a49f3cdd8b644a88922f6531661aff5"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "c60a1874590fe30f680bd393ad37288a"
server_key_iv: "6fd4d154729656085b4ff698879547e7"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.126982 12489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "9a49f3cdd8b644a88922f6531661aff5"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "c60a1874590fe30f680bd393ad37288a"
server_key_iv: "6fd4d154729656085b4ff698879547e7"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.131349 12489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 03:49:30.133900 12505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:30.135373 12489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:49:30.135524 12489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "9a49f3cdd8b644a88922f6531661aff5"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "c60a1874590fe30f680bd393ad37288a"
server_key_iv: "6fd4d154729656085b4ff698879547e7"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.135648 12489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:30.155102 12489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:30.158579 12489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:30.158793 12489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:30.159438 12489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:30.160439 12489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:30.160511 12489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:30.160600 12489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:30.160640 12489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:30.169854 12489 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:36369
I20260810 03:49:30.169876 12637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:36369 every 8 connection(s)
I20260810 03:49:30.170800 12489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:49:30.171643 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 12489
I20260810 03:49:30.171792 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:49:30.172215 23067 external_mini_cluster.cc:1428] Setting key ec20325e7325c9254221f9b9871d02a0
Aug 10 03:49:30 dist-test-slave-qg60 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.195@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:30.185729 12148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.172883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:34309 (local address 127.22.134.254:37377)
0810 03:49:30.173041 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.173046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.174228 (+ 1182us) server_negotiation.cc:407] Connection header received
0810 03:49:30.175674 (+ 1446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.175677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.175756 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.175871 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:30.177253 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.177808 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.179011 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.179258 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.179347 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.181911 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:30.181914 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:30.181916 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:30.181941 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:30.183535 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:30.184080 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:30.184082 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:30.184083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:30.184158 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:30.184493 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:30.184496 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:30.184498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:30.184687 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:30.184838 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.185424 (+ 586us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.185554 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 03:49:30.186681 12642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.173440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:37377 (local address 127.22.134.195:34309)
0810 03:49:30.174039 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.174103 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:30.175457 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:30.176076 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:30.176083 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:30.176465 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:30.177106 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.177122 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.177944 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.177946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.178897 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.178906 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.179395 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.179397 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.179554 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.180131 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:49:30.180148 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:30.181736 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:30.183677 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:30.183683 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:30.183700 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:30.183958 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:30.184247 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:49:30.184252 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:49:30.184254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:49:30.184392 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:49:30.184834 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:30.184840 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:30.185138 (+ 298us) client_negotiation.cc:769] Sending connection context
0810 03:49:30.185357 (+ 219us) client_negotiation.cc:240] Negotiation successful
0810 03:49:30.185708 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":179,"threads_started":1}
I20260810 03:49:30.187752 12638 heartbeater.cc:347] Connected to a master server at 127.22.134.254:37377
I20260810 03:49:30.188087 12638 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:30.188618 12638 heartbeater.cc:511] Master 127.22.134.254:37377 requested a full tablet report, sending...
I20260810 03:49:30.189714 12103 ts_manager.cc:194] Registered new tserver with Master: 9a49f3cdd8b644a88922f6531661aff5 (127.22.134.195:36369)
I20260810 03:49:30.190371 12103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.134.195@KRBTEST.COM'} at 127.22.134.195:34309
I20260810 03:49:30.198742 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:49:30.209326 12148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.201020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33064 (local address 127.22.134.254:37377)
0810 03:49:30.201136 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.201140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.201457 (+ 317us) server_negotiation.cc:407] Connection header received
0810 03:49:30.201583 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.201585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.201637 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.201710 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:30.202525 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.203049 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.204101 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.204321 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.204455 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.206058 (+ 1603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:30.206061 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:30.206063 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:30.206088 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:30.207481 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:30.207913 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:30.207916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:30.207917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:30.208065 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:30.208351 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:30.208355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:30.208356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:30.208638 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:30.208846 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.209078 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.209194 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 03:49:30.212409 12103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:49:30.215545 12103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:49:30.230826 12653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.224259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:45089 (local address 127.0.0.1:38628)
0810 03:49:30.225380 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.225435 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:30.225576 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:30.226198 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:30.226204 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:30.226241 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:30.226648 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.226655 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.228083 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.228086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.229309 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.229320 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.230235 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.230239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.230348 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.230386 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 03:49:30.230503 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 03:49:30.230640 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"mutex_wait_us":64,"spinlock_wait_cycles":6272,"thread_start_us":130,"threads_started":1}
I20260810 03:49:30.230839 12651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.224416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:36933 (local address 127.0.0.1:55804)
0810 03:49:30.225433 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.225445 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:30.225576 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:30.226205 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:30.226208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:30.226242 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:30.226424 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.226433 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.227632 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.227637 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.229318 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.229330 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.230498 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.230502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.230584 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.230604 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 03:49:30.230684 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 03:49:30.230743 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":965,"mutex_wait_us":18,"spinlock_wait_cycles":7040,"thread_start_us":125,"threads_started":1}
I20260810 03:49:30.231218 12654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.224603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55804 (local address 127.22.134.194:36933)
0810 03:49:30.225783 (+ 1180us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.225797 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.225821 (+ 24us) server_negotiation.cc:407] Connection header received
0810 03:49:30.225892 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.225896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.226040 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.226335 (+ 295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:30.226554 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.227467 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.229470 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.230334 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.230492 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.230609 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.230955 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.231064 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1064,"thread_start_us":157,"threads_started":1}
I20260810 03:49:30.231490 12652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.224418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38628 (local address 127.22.134.193:45089)
0810 03:49:30.225116 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.225124 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.225719 (+ 595us) server_negotiation.cc:407] Connection header received
0810 03:49:30.225807 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.225813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.226030 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.226191 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:30.226770 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.227948 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.229433 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.230104 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.230244 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.230395 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.230707 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.230817 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":125,"threads_started":1}
I20260810 03:49:30.231734 12655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.225159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:36369 (local address 127.0.0.1:60264)
0810 03:49:30.225620 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.225636 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:30.225732 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:30.226416 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:30.226418 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:30.226433 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:30.226508 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.226512 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.227967 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.227971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.229341 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.229347 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.230680 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.230684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.231437 (+ 753us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.231469 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 03:49:30.231540 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 03:49:30.231610 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":65,"thread_start_us":90,"threads_started":1}
I20260810 03:49:30.232098 12656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.225364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60264 (local address 127.22.134.195:36369)
0810 03:49:30.225874 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.225889 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.225907 (+ 18us) server_negotiation.cc:407] Connection header received
0810 03:49:30.225982 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.225987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.226150 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.226277 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:30.226623 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.227797 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.229470 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.230329 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.230470 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.230609 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.231852 (+ 1243us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.231957 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":143,"threads_started":1}
I20260810 03:49:30.234455 12404 tablet_service.cc:1467] Processing CreateTablet for tablet d1efed18aa224372aae4cd57450ddb68 (DEFAULT_TABLE table=test-table [id=9455d49acf5e4377bd2b95be1d87927a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:30.234453 12246 tablet_service.cc:1467] Processing CreateTablet for tablet d1efed18aa224372aae4cd57450ddb68 (DEFAULT_TABLE table=test-table [id=9455d49acf5e4377bd2b95be1d87927a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:30.234437 12562 tablet_service.cc:1467] Processing CreateTablet for tablet d1efed18aa224372aae4cd57450ddb68 (DEFAULT_TABLE table=test-table [id=9455d49acf5e4377bd2b95be1d87927a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:30.235631 12404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1efed18aa224372aae4cd57450ddb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:30.235630 12246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1efed18aa224372aae4cd57450ddb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:30.235632 12562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1efed18aa224372aae4cd57450ddb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:30.242225 12657 tablet_bootstrap.cc:492] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: Bootstrap starting.
I20260810 03:49:30.243954 12659 tablet_bootstrap.cc:492] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d: Bootstrap starting.
I20260810 03:49:30.244938 12657 tablet_bootstrap.cc:654] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:30.245116 12661 tablet_bootstrap.cc:492] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: Bootstrap starting.
I20260810 03:49:30.246332 12657 log.cc:824] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:30.246408 12659 tablet_bootstrap.cc:654] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:30.247149 12659 log.cc:824] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:30.247215 12661 tablet_bootstrap.cc:654] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:30.248337 12661 log.cc:824] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:30.248750 12657 tablet_bootstrap.cc:492] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: No bootstrap required, opened a new log
I20260810 03:49:30.248955 12657 ts_tablet_manager.cc:1397] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260810 03:49:30.249295 12659 tablet_bootstrap.cc:492] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d: No bootstrap required, opened a new log
I20260810 03:49:30.249480 12659 ts_tablet_manager.cc:1397] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:49:30.250092 12661 tablet_bootstrap.cc:492] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: No bootstrap required, opened a new log
I20260810 03:49:30.250280 12661 ts_tablet_manager.cc:1397] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 03:49:30.253196 12661 raft_consensus.cc:348] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.253304 12657 raft_consensus.cc:348] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.253507 12661 raft_consensus.cc:374] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:30.253561 12657 raft_consensus.cc:374] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:30.253575 12661 raft_consensus.cc:729] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 820e959447a347e38f18a3f5c332d6f1, State: Initialized, Role: FOLLOWER
I20260810 03:49:30.253615 12657 raft_consensus.cc:729] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a49f3cdd8b644a88922f6531661aff5, State: Initialized, Role: FOLLOWER
I20260810 03:49:30.254031 12661 consensus_queue.cc:260] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.253947 12659 raft_consensus.cc:348] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.254091 12657 consensus_queue.cc:260] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.254204 12659 raft_consensus.cc:374] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:30.254251 12659 raft_consensus.cc:729] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac0dde85b6749839512f1f0b502da0d, State: Initialized, Role: FOLLOWER
I20260810 03:49:30.254644 12659 consensus_queue.cc:260] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.254716 12484 heartbeater.cc:503] Master 127.22.134.254:37377 was elected leader, sending a full tablet report...
I20260810 03:49:30.255100 12661 ts_tablet_manager.cc:1428] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 03:49:30.255113 12657 ts_tablet_manager.cc:1428] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 03:49:30.255448 12638 heartbeater.cc:503] Master 127.22.134.254:37377 was elected leader, sending a full tablet report...
I20260810 03:49:30.255489 12659 ts_tablet_manager.cc:1428] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260810 03:49:30.255777 12327 heartbeater.cc:503] Master 127.22.134.254:37377 was elected leader, sending a full tablet report...
I20260810 03:49:30.315166 12666 raft_consensus.cc:482] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:30.315457 12666 raft_consensus.cc:504] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.316896 12666 leader_election.cc:288] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eac0dde85b6749839512f1f0b502da0d (127.22.134.193:45089), 820e959447a347e38f18a3f5c332d6f1 (127.22.134.194:36933)
I20260810 03:49:30.321475 12642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.317121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:45089 (local address 127.22.134.195:36949)
0810 03:49:30.317367 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.317384 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:30.317495 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:30.317841 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:30.317845 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:30.317870 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:30.318006 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.318012 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.319014 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.319017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.319948 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.319958 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.320966 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.320970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.321105 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.321141 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 03:49:30.321226 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 03:49:30.321319 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134}
I20260810 03:49:30.321475 12652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.317251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:36949 (local address 127.22.134.193:45089)
0810 03:49:30.317417 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.317424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.317444 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:49:30.317636 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.317641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.317698 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.317788 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:30.318163 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.318893 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.320109 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.320831 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.320977 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.321039 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.321246 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.321334 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:49:30.321663 12654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.317732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:49877 (local address 127.22.134.194:36933)
0810 03:49:30.317895 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.317900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.318092 (+ 192us) server_negotiation.cc:407] Connection header received
0810 03:49:30.318226 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.318229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.318273 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.318329 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:30.318619 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.319182 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.320370 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.320925 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.321050 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.321121 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.321415 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.321503 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:49:30.322057 12669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.317180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:36933 (local address 127.22.134.195:49877)
0810 03:49:30.317998 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.318011 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:30.318127 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:30.318361 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:30.318364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:30.318384 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:30.318512 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.318518 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.319306 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.319309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.320248 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.320259 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.321187 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.321190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.321288 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.321310 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:49:30.321389 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 03:49:30.321452 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":141,"threads_started":1}
I20260810 03:49:30.322271 12269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1efed18aa224372aae4cd57450ddb68" candidate_uuid: "9a49f3cdd8b644a88922f6531661aff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac0dde85b6749839512f1f0b502da0d" is_pre_election: true
I20260810 03:49:30.322665 12269 raft_consensus.cc:2454] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a49f3cdd8b644a88922f6531661aff5 in term 0.
I20260810 03:49:30.322670 12429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1efed18aa224372aae4cd57450ddb68" candidate_uuid: "9a49f3cdd8b644a88922f6531661aff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "820e959447a347e38f18a3f5c332d6f1" is_pre_election: true
I20260810 03:49:30.322952 12429 raft_consensus.cc:2454] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a49f3cdd8b644a88922f6531661aff5 in term 0.
I20260810 03:49:30.323271 12506 leader_election.cc:302] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a49f3cdd8b644a88922f6531661aff5, eac0dde85b6749839512f1f0b502da0d; no voters:
I20260810 03:49:30.323585 12666 raft_consensus.cc:2781] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:49:30.323691 12666 raft_consensus.cc:482] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:49:30.323742 12666 raft_consensus.cc:3037] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:30.324959 12666 raft_consensus.cc:504] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.325366 12666 leader_election.cc:288] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [CANDIDATE]: Term 1 election: Requested vote from peers eac0dde85b6749839512f1f0b502da0d (127.22.134.193:45089), 820e959447a347e38f18a3f5c332d6f1 (127.22.134.194:36933)
I20260810 03:49:30.325795 12269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1efed18aa224372aae4cd57450ddb68" candidate_uuid: "9a49f3cdd8b644a88922f6531661aff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac0dde85b6749839512f1f0b502da0d"
I20260810 03:49:30.325855 12429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1efed18aa224372aae4cd57450ddb68" candidate_uuid: "9a49f3cdd8b644a88922f6531661aff5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "820e959447a347e38f18a3f5c332d6f1"
I20260810 03:49:30.325954 12269 raft_consensus.cc:3037] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:30.326007 12429 raft_consensus.cc:3037] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:30.327153 12429 raft_consensus.cc:2454] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a49f3cdd8b644a88922f6531661aff5 in term 1.
I20260810 03:49:30.327164 12269 raft_consensus.cc:2454] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a49f3cdd8b644a88922f6531661aff5 in term 1.
I20260810 03:49:30.327572 12508 leader_election.cc:302] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 820e959447a347e38f18a3f5c332d6f1, 9a49f3cdd8b644a88922f6531661aff5; no voters:
I20260810 03:49:30.327793 12666 raft_consensus.cc:2781] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:30.328099 12666 raft_consensus.cc:686] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 1 LEADER]: Becoming Leader. State: Replica: 9a49f3cdd8b644a88922f6531661aff5, State: Running, Role: LEADER
I20260810 03:49:30.328485 12666 consensus_queue.cc:237] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } }
I20260810 03:49:30.332221 12103 catalog_manager.cc:5495] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a49f3cdd8b644a88922f6531661aff5 (127.22.134.195). New cstate: current_term: 1 leader_uuid: "9a49f3cdd8b644a88922f6531661aff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a49f3cdd8b644a88922f6531661aff5" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 36369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 } health_report { overall_health: UNKNOWN } } }
I20260810 03:49:30.353945 12656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.350279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60280 (local address 127.22.134.195:36369)
0810 03:49:30.350442 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.350446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.350482 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:49:30.350557 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.350560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.350616 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.350707 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:49:30.351075 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.351584 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.352443 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.352666 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.352827 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.353084 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:49:30.353518 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:49:30.353622 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.353694 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.353747 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 03:49:30.360301 12429 raft_consensus.cc:1261] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 1 FOLLOWER]: Refusing update from remote peer 9a49f3cdd8b644a88922f6531661aff5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:30.360311 12269 raft_consensus.cc:1261] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d [term 1 FOLLOWER]: Refusing update from remote peer 9a49f3cdd8b644a88922f6531661aff5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:30.361093 12666 consensus_queue.cc:1035] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "820e959447a347e38f18a3f5c332d6f1" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:30.361321 12670 consensus_queue.cc:1035] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac0dde85b6749839512f1f0b502da0d" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:30.379511 12103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:30.379725 12103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:30.382387 12103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d73cefd79d80440a99277783b48057c6: Sending DeleteTablet for 3 replicas of tablet d1efed18aa224372aae4cd57450ddb68
I20260810 03:49:30.383400 12246 tablet_service.cc:1514] Processing DeleteTablet for tablet d1efed18aa224372aae4cd57450ddb68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:30 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:38628
I20260810 03:49:30.383400 12404 tablet_service.cc:1514] Processing DeleteTablet for tablet d1efed18aa224372aae4cd57450ddb68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:30 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:55804
I20260810 03:49:30.383512 12562 tablet_service.cc:1514] Processing DeleteTablet for tablet d1efed18aa224372aae4cd57450ddb68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:30 UTC) from {username='kudu', principal='kudu/127.22.134.254@KRBTEST.COM'} at 127.0.0.1:60264
I20260810 03:49:30.383984 12687 tablet_replica.cc:330] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: stopping tablet replica
I20260810 03:49:30.384224 12686 tablet_replica.cc:330] T d1efed18aa224372aae4cd57450ddb68 P eac0dde85b6749839512f1f0b502da0d: stopping tablet replica
I20260810 03:49:30.384317 12687 raft_consensus.cc:2229] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:49:30.384407 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 12172
I20260810 03:49:30.384758 12687 raft_consensus.cc:2258] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:30.388427 12687 ts_tablet_manager.cc:1905] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:30.383952 12684 tablet_replica.cc:330] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: stopping tablet replica
I20260810 03:49:30.389443 12684 raft_consensus.cc:2229] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:30.389878 12684 raft_consensus.cc:2258] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:30.391355 12687 ts_tablet_manager.cc:1918] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:30.391458 12687 log.cc:1196] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/d1efed18aa224372aae4cd57450ddb68
I20260810 03:49:30.391685 12684 ts_tablet_manager.cc:1905] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:30.391798 12687 ts_tablet_manager.cc:1939] T d1efed18aa224372aae4cd57450ddb68 P 9a49f3cdd8b644a88922f6531661aff5: Deleting consensus metadata
I20260810 03:49:30.393281 12084 catalog_manager.cc:4841] TS 9a49f3cdd8b644a88922f6531661aff5 (127.22.134.195:36369): tablet d1efed18aa224372aae4cd57450ddb68 (table test-table [id=9455d49acf5e4377bd2b95be1d87927a]) successfully deleted
I20260810 03:49:30.395301 12684 ts_tablet_manager.cc:1918] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:30.395488 12684 log.cc:1196] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/d1efed18aa224372aae4cd57450ddb68
I20260810 03:49:30.395943 12684 ts_tablet_manager.cc:1939] T d1efed18aa224372aae4cd57450ddb68 P 820e959447a347e38f18a3f5c332d6f1: Deleting consensus metadata
W20260810 03:49:30.396025 12084 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:45089 (error 108)
I20260810 03:49:30.397168 12655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.396871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:45089 (local address 127.0.0.1:38640)
0810 03:49:30.397008 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.397082 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:45089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 03:49:30.397292 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 12334
W20260810 03:49:30.404896 12084 catalog_manager.cc:4584] TS eac0dde85b6749839512f1f0b502da0d (127.22.134.193:45089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d1efed18aa224372aae4cd57450ddb68: Network error: Client connection negotiation failed: client connection to 127.22.134.193:45089: connect: Connection refused (error 111)
I20260810 03:49:30.407949 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 12489
I20260810 03:49:30.408288 12655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.407989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:36933 (local address 127.0.0.1:55816)
0810 03:49:30.408130 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.408193 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.194:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 03:49:30.418591 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 12065
2026-08-10T03:49:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2469 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T03:49:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:30Z Disabled control of system clock
I20260810 03:49:30.454020 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35189
--webserver_interface=127.22.134.254
--webserver_port=0
--builtin_ntp_servers=127.22.134.212:38269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:35189
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:49:30.578593 12693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:30.578910 12693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:30.578953 12693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:30.583811 12693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:30.583882 12693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:30.583899 12693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:30.583916 12693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:30.583931 12693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:30.589457 12693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:35189
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:30.590793 12693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:30.592379 12693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:30.601649 12701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:30.601729 12699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:30.601649 12698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:30.602053 12693 server_base.cc:1034] running on GCE node
I20260810 03:49:30.602741 12693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:30.604018 12693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:30.605252 12693 hybrid_clock.cc:648] HybridClock initialized: now 1786333770605231 us; error 34 us; skew 500 ppm
I20260810 03:49:30.607388 12693 webserver.cc:460] Webserver started at http://127.22.134.254:42933/ using document root <none> and password file <none>
I20260810 03:49:30.608009 12693 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:30.608111 12693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:30.608361 12693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:30.610915 12693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "3d697c94a3ce4961ac79d481c388c101"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "689753d303e0624d0452a72b7f0fa3d4"
server_key_iv: "2d965ca402efafb8218a3c9e31ec5989"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.611552 12693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "3d697c94a3ce4961ac79d481c388c101"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "689753d303e0624d0452a72b7f0fa3d4"
server_key_iv: "2d965ca402efafb8218a3c9e31ec5989"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.615593 12693 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:49:30.618610 12708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:30.620277 12693 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:49:30.620460 12693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "3d697c94a3ce4961ac79d481c388c101"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "689753d303e0624d0452a72b7f0fa3d4"
server_key_iv: "2d965ca402efafb8218a3c9e31ec5989"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.620610 12693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:30.637246 12693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:30.638110 12693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:30.638365 12693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:30.646554 12693 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:35189
I20260810 03:49:30.646567 12771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:35189 every 8 connection(s)
I20260810 03:49:30.647719 12693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:30.651286 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 12693
I20260810 03:49:30.651434 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:30.651610 12772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:30.651789 23067 external_mini_cluster.cc:1428] Setting key 42bd79f929ca48672e788d01552589fe
I20260810 03:49:30.658809 12772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101: Bootstrap starting.
I20260810 03:49:30.661494 12772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:30.662065 12775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.653381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49248 (local address 127.22.134.254:35189)
0810 03:49:30.654153 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.654175 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.654214 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:49:30.655163 (+ 949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.655186 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.655614 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.655981 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:30.656444 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.657500 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.658437 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.658936 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.659142 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.660004 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:30.660009 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:30.660022 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:30.660487 (+ 465us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:30.660545 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:30.660565 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:30.660647 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.660861 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.661219 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":168,"threads_started":1}
I20260810 03:49:30.662367 12772 log.cc:824] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:30.664330 12772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101: No bootstrap required, opened a new log
I20260810 03:49:30.668267 12772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d697c94a3ce4961ac79d481c388c101" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35189 } }
I20260810 03:49:30.668538 12772 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:30.668624 12772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d697c94a3ce4961ac79d481c388c101, State: Initialized, Role: FOLLOWER
I20260810 03:49:30.669147 12772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d697c94a3ce4961ac79d481c388c101" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35189 } }
I20260810 03:49:30.669339 12772 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:30.669414 12772 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:30.669519 12772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:30.670495 12772 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d697c94a3ce4961ac79d481c388c101" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35189 } }
I20260810 03:49:30.670845 12772 leader_election.cc:302] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d697c94a3ce4961ac79d481c388c101; no voters:
I20260810 03:49:30.671191 12772 leader_election.cc:288] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:30.671300 12778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:30.671610 12778 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [term 1 LEADER]: Becoming Leader. State: Replica: 3d697c94a3ce4961ac79d481c388c101, State: Running, Role: LEADER
I20260810 03:49:30.672390 12778 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d697c94a3ce4961ac79d481c388c101" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35189 } }
I20260810 03:49:30.672587 12772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:30.674232 12781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d697c94a3ce4961ac79d481c388c101. Latest consensus state: current_term: 1 leader_uuid: "3d697c94a3ce4961ac79d481c388c101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d697c94a3ce4961ac79d481c388c101" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35189 } } }
I20260810 03:49:30.674288 12779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d697c94a3ce4961ac79d481c388c101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d697c94a3ce4961ac79d481c388c101" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35189 } } }
I20260810 03:49:30.674367 12781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:30.674402 12779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:30.674783 12789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:30.678074 12789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:30.683609 12789 catalog_manager.cc:1347] Generated new cluster ID: 0f7d0897f9c04ad88f0f8c070217afaf
I20260810 03:49:30.683699 12789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:30.701025 12789 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:30.702010 12789 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:30.722143 12789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101: Generated new TSK 0
I20260810 03:49:30.723042 12789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:30.729250 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.193:0
--local_ip_for_outbound_sockets=127.22.134.193
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35189
--builtin_ntp_servers=127.22.134.212:38269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 03:49:30.857084 12800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:30.857385 12800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:30.857427 12800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:30.861694 12800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:30.861760 12800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:30.861817 12800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.193
I20260810 03:49:30.866902 12800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.134.193
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.193
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:30.868119 12800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:30.869689 12800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:30.880119 12805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:30.880127 12808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:30.880196 12800 server_base.cc:1034] running on GCE node
W20260810 03:49:30.880164 12806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:30.880939 12800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:30.881647 12800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:30.882846 12800 hybrid_clock.cc:648] HybridClock initialized: now 1786333770882812 us; error 46 us; skew 500 ppm
I20260810 03:49:30.884785 12800 webserver.cc:460] Webserver started at http://127.22.134.193:35553/ using document root <none> and password file <none>
I20260810 03:49:30.885387 12800 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:30.885480 12800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:30.885730 12800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:30.887830 12800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/data/instance:
uuid: "26fcd71d49a44a908173173f17ecbddc"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "48e43943498517c8950f4e38927c3937"
server_key_iv: "c842697619cdd50ca98b9688cca254f3"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.888411 12800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance:
uuid: "26fcd71d49a44a908173173f17ecbddc"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "48e43943498517c8950f4e38927c3937"
server_key_iv: "c842697619cdd50ca98b9688cca254f3"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.892328 12800 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:49:30.895133 12816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:30.896492 12800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 03:49:30.896775 12800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/wal
uuid: "26fcd71d49a44a908173173f17ecbddc"
format_stamp: "Formatted at 2026-08-10 03:49:30 on dist-test-slave-qg60"
server_key: "48e43943498517c8950f4e38927c3937"
server_key_iv: "c842697619cdd50ca98b9688cca254f3"
server_key_version: "encryptionkey@0"
I20260810 03:49:30.896914 12800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:30.908200 12800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:30.909076 12800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:30.909336 12800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:30.910070 12800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:30.911101 12800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:30.911187 12800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:30.911268 12800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:30.911316 12800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:30.921649 12800 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.193:40509
I20260810 03:49:30.921696 12946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.193:40509 every 8 connection(s)
I20260810 03:49:30.922696 12800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/data/info.pb
I20260810 03:49:30.930263 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 12800
I20260810 03:49:30.930400 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-0/wal/instance
I20260810 03:49:30.930788 23067 external_mini_cluster.cc:1428] Setting key 62ce136963af3de2bf256412b856131d
I20260810 03:49:30.933194 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.194:0
--local_ip_for_outbound_sockets=127.22.134.194
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35189
--builtin_ntp_servers=127.22.134.212:38269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:49:30.933282 12775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.924916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.193:60993 (local address 127.22.134.254:35189)
0810 03:49:30.925074 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:30.925078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:30.926351 (+ 1273us) server_negotiation.cc:407] Connection header received
0810 03:49:30.927870 (+ 1519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:30.927874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:30.927940 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:30.928052 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:30.929040 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.929598 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.930931 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.931154 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.931276 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.932676 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:30.932717 (+ 41us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:30.932719 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:30.932774 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:30.932801 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:30.932818 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:30.932902 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:30.933072 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 03:49:30.933138 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:49:30.934455 12949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:30.925385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35189 (local address 127.22.134.193:60993)
0810 03:49:30.926155 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:30.926206 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:30.927615 (+ 1409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:30.928243 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:30.928250 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:30.928340 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:30.928874 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.928887 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.929749 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.929752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.930770 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:30.930781 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:30.931327 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:30.931332 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:30.931496 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:30.932373 (+ 877us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:30.932376 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:30.932434 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:30.932515 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:30.932905 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:30.932917 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:30.932923 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:49:30.933062 (+ 139us) client_negotiation.cc:240] Negotiation successful
0810 03:49:30.933676 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":148,"threads_started":1}
I20260810 03:49:30.935961 12947 heartbeater.cc:347] Connected to a master server at 127.22.134.254:35189
I20260810 03:49:30.936311 12947 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:30.936973 12947 heartbeater.cc:511] Master 127.22.134.254:35189 requested a full tablet report, sending...
I20260810 03:49:30.938730 12727 ts_manager.cc:194] Registered new tserver with Master: 26fcd71d49a44a908173173f17ecbddc (127.22.134.193:40509)
I20260810 03:49:30.939972 12727 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.193:60993
W20260810 03:49:31.051514 12950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:31.051810 12950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:31.051851 12950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:31.056092 12950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:31.056171 12950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:31.056229 12950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.194
I20260810 03:49:31.061319 12950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.134.194
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.194
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:31.062549 12950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:31.064039 12950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:31.074504 12956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:31.074504 12955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:31.074703 12958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:31.075081 12950 server_base.cc:1034] running on GCE node
I20260810 03:49:31.075510 12950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:31.076153 12950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:31.077316 12950 hybrid_clock.cc:648] HybridClock initialized: now 1786333771077297 us; error 34 us; skew 500 ppm
I20260810 03:49:31.079515 12950 webserver.cc:460] Webserver started at http://127.22.134.194:45055/ using document root <none> and password file <none>
I20260810 03:49:31.080128 12950 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:31.080214 12950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:31.080461 12950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:31.082654 12950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/data/instance:
uuid: "b0128951bac545aa8f7fa6085e519aeb"
format_stamp: "Formatted at 2026-08-10 03:49:31 on dist-test-slave-qg60"
server_key: "18aad865cb4c5bf8991f6df4e8b700d8"
server_key_iv: "a4d020ac03390d706c135a3447b4af77"
server_key_version: "encryptionkey@0"
I20260810 03:49:31.083223 12950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance:
uuid: "b0128951bac545aa8f7fa6085e519aeb"
format_stamp: "Formatted at 2026-08-10 03:49:31 on dist-test-slave-qg60"
server_key: "18aad865cb4c5bf8991f6df4e8b700d8"
server_key_iv: "a4d020ac03390d706c135a3447b4af77"
server_key_version: "encryptionkey@0"
I20260810 03:49:31.087354 12950 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:31.090071 12964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:31.091356 12950 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:49:31.091485 12950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/wal
uuid: "b0128951bac545aa8f7fa6085e519aeb"
format_stamp: "Formatted at 2026-08-10 03:49:31 on dist-test-slave-qg60"
server_key: "18aad865cb4c5bf8991f6df4e8b700d8"
server_key_iv: "a4d020ac03390d706c135a3447b4af77"
server_key_version: "encryptionkey@0"
I20260810 03:49:31.091603 12950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:31.113392 12950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:31.114151 12950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:31.114360 12950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:31.115010 12950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:31.116050 12950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:31.116135 12950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:31.116231 12950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:31.116278 12950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:31.126186 12950 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.194:34369
I20260810 03:49:31.126225 13097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.194:34369 every 8 connection(s)
I20260810 03:49:31.127465 12950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/data/info.pb
I20260810 03:49:31.131633 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 12950
I20260810 03:49:31.131784 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/wal/instance
I20260810 03:49:31.132110 23067 external_mini_cluster.cc:1428] Setting key 3280f24fe16671d2b33547dec29d2af2
I20260810 03:49:31.134629 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.134.195:0
--local_ip_for_outbound_sockets=127.22.134.195
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35189
--builtin_ntp_servers=127.22.134.212:38269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 03:49:31.138660 12775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.129600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.194:39857 (local address 127.22.134.254:35189)
0810 03:49:31.129791 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.129797 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.130914 (+ 1117us) server_negotiation.cc:407] Connection header received
0810 03:49:31.132506 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.132510 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.132561 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.132637 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:31.133928 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.134867 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.136074 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.136521 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.136627 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.138133 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:31.138136 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:31.138139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:31.138153 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:31.138180 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:31.138188 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:31.138264 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.138441 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.138515 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 03:49:31.139562 13101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.130065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35189 (local address 127.22.134.194:39857)
0810 03:49:31.130762 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:31.130805 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:31.132273 (+ 1468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:31.132916 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:31.132929 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:31.133040 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:31.133748 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.133770 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.135033 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.135036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.135930 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.135939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.136715 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.136721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.136965 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.137819 (+ 854us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:31.137821 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:31.137862 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:31.137961 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:31.138279 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:31.138290 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:31.138296 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 03:49:31.138439 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 03:49:31.138746 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":121,"threads_started":1}
I20260810 03:49:31.140936 13098 heartbeater.cc:347] Connected to a master server at 127.22.134.254:35189
I20260810 03:49:31.141198 13098 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:31.141731 13098 heartbeater.cc:511] Master 127.22.134.254:35189 requested a full tablet report, sending...
I20260810 03:49:31.142859 12727 ts_manager.cc:194] Registered new tserver with Master: b0128951bac545aa8f7fa6085e519aeb (127.22.134.194:34369)
I20260810 03:49:31.143440 12727 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.194:39857
W20260810 03:49:31.258167 13102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:31.258528 13102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:31.258623 13102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:31.263315 13102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:31.263406 13102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:31.263506 13102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.134.195
I20260810 03:49:31.268555 13102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.134.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.134.195
--webserver_port=0
--tserver_master_addrs=127.22.134.254:35189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.134.195
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:31.269737 13102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:31.271144 13102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:49:31.281580 13102 server_base.cc:1034] running on GCE node
W20260810 03:49:31.281471 13107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:31.281462 13112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:31.281499 13110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:31.282205 13102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:31.282917 13102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:31.284116 13102 hybrid_clock.cc:648] HybridClock initialized: now 1786333771284094 us; error 33 us; skew 500 ppm
I20260810 03:49:31.286038 13102 webserver.cc:460] Webserver started at http://127.22.134.195:45905/ using document root <none> and password file <none>
I20260810 03:49:31.286640 13102 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:31.286733 13102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:31.286974 13102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:31.289173 13102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/data/instance:
uuid: "ab21fb5453c344d3a7d7abb448412dac"
format_stamp: "Formatted at 2026-08-10 03:49:31 on dist-test-slave-qg60"
server_key: "94945f507320dc91c9ef0e5a26df83e8"
server_key_iv: "a269202d9841cc39d6484ee72772f42e"
server_key_version: "encryptionkey@0"
I20260810 03:49:31.289773 13102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance:
uuid: "ab21fb5453c344d3a7d7abb448412dac"
format_stamp: "Formatted at 2026-08-10 03:49:31 on dist-test-slave-qg60"
server_key: "94945f507320dc91c9ef0e5a26df83e8"
server_key_iv: "a269202d9841cc39d6484ee72772f42e"
server_key_version: "encryptionkey@0"
I20260810 03:49:31.293849 13102 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:31.296837 13119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:31.298244 13102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:49:31.298396 13102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/wal
uuid: "ab21fb5453c344d3a7d7abb448412dac"
format_stamp: "Formatted at 2026-08-10 03:49:31 on dist-test-slave-qg60"
server_key: "94945f507320dc91c9ef0e5a26df83e8"
server_key_iv: "a269202d9841cc39d6484ee72772f42e"
server_key_version: "encryptionkey@0"
I20260810 03:49:31.298547 13102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:31.316885 13102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:31.317688 13102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:31.317921 13102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:31.318567 13102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 03:49:31.319597 13102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 03:49:31.319675 13102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:31.319756 13102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 03:49:31.319802 13102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:31.329633 13102 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.195:41787
I20260810 03:49:31.329654 13247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.195:41787 every 8 connection(s)
I20260810 03:49:31.330626 13102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/data/info.pb
I20260810 03:49:31.333036 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 13102
I20260810 03:49:31.333187 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/wal/instance
I20260810 03:49:31.333518 23067 external_mini_cluster.cc:1428] Setting key bebe757a590af6bbe3c524700cf5a9c2
I20260810 03:49:31.340844 12775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.332593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:43003 (local address 127.22.134.254:35189)
0810 03:49:31.332767 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.332772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.334254 (+ 1482us) server_negotiation.cc:407] Connection header received
0810 03:49:31.335885 (+ 1631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.335889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.335949 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.336024 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:31.337050 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.337606 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.338766 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.339003 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.339114 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.340301 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:31.340306 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:31.340313 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:31.340326 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:31.340346 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:31.340354 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:31.340434 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.340600 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.340667 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:49:31.341722 13251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.333044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:35189 (local address 127.22.134.195:43003)
0810 03:49:31.333868 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:31.333928 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:31.335681 (+ 1753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:31.336225 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:31.336232 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:31.336331 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:49:31.336904 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.336920 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.337739 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.337743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.338635 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.338643 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.339157 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.339161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.339321 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.339937 (+ 616us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 03:49:31.339939 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:49:31.339979 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 03:49:31.340143 (+ 164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:49:31.340437 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:49:31.340449 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:49:31.340456 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 03:49:31.340587 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 03:49:31.340912 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":162,"threads_started":1}
I20260810 03:49:31.342837 13249 heartbeater.cc:347] Connected to a master server at 127.22.134.254:35189
I20260810 03:49:31.343125 13249 heartbeater.cc:464] Registering TS with master...
I20260810 03:49:31.343667 13249 heartbeater.cc:511] Master 127.22.134.254:35189 requested a full tablet report, sending...
I20260810 03:49:31.344827 12727 ts_manager.cc:194] Registered new tserver with Master: ab21fb5453c344d3a7d7abb448412dac (127.22.134.195:41787)
I20260810 03:49:31.345417 12727 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.134.195:43003
I20260810 03:49:31.347870 23067 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 03:49:31.353821 12775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.350032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49262 (local address 127.22.134.254:35189)
0810 03:49:31.350158 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.350162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.350312 (+ 150us) server_negotiation.cc:407] Connection header received
0810 03:49:31.350380 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.350383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.350425 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.350506 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:31.350785 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.351330 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.352196 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.352405 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.352495 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.353432 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:31.353435 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:31.353437 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:31.353449 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:31.353467 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:31.353475 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:31.353560 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.353662 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.353715 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:49:31.356878 12727 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 03:49:31.359912 12727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 03:49:31.374660 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.368780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:40509 (local address 127.0.0.1:43954)
0810 03:49:31.369554 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:31.369612 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:31.369761 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:31.370559 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:31.370565 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:31.370589 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:31.370751 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.370758 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.371851 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.371857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.373179 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.373209 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.374104 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.374108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.374225 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.374270 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 03:49:31.374369 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 03:49:31.374499 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":107,"spinlock_wait_cycles":7424,"thread_start_us":139,"threads_started":1}
I20260810 03:49:31.374706 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.369040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43954 (local address 127.22.134.193:40509)
0810 03:49:31.370070 (+ 1030us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.370083 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.370109 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:49:31.370197 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.370202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.370406 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.370567 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:31.370918 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.371733 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.373333 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.373977 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.374114 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.374370 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.374424 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.374531 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":915,"thread_start_us":133,"threads_started":1}
I20260810 03:49:31.375434 13262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.368780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.195:41787 (local address 127.0.0.1:45778)
0810 03:49:31.369554 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:31.369627 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:31.369761 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:31.370824 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:31.370830 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:31.370853 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:31.370952 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.370961 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.372426 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.372430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.373838 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.373849 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.374985 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.374989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.375095 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.375119 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 03:49:31.375229 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 03:49:31.375300 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":92,"spinlock_wait_cycles":3200,"thread_start_us":93,"threads_started":1}
I20260810 03:49:31.375929 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.369940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50456 (local address 127.22.134.194:34369)
0810 03:49:31.370408 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.370419 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.370439 (+ 20us) server_negotiation.cc:407] Connection header received
0810 03:49:31.370503 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.370506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.370681 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.370832 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:31.371274 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.372403 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.374005 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.375297 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.375437 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.375618 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.375673 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.375764 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":159,"threads_started":1}
I20260810 03:49:31.375823 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.369510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:34369 (local address 127.0.0.1:50456)
0810 03:49:31.370056 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:31.370070 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:31.370233 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:31.370987 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:31.370990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:31.371005 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:31.371123 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.371131 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.372548 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.372551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.373846 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.373852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.375428 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.375432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.375527 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.375549 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 03:49:31.375612 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 03:49:31.375691 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":76,"thread_start_us":95,"threads_started":1}
I20260810 03:49:31.377310 13263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.368888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45778 (local address 127.22.134.195:41787)
0810 03:49:31.370371 (+ 1483us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.370383 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.370408 (+ 25us) server_negotiation.cc:407] Connection header received
0810 03:49:31.370499 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.370504 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.370682 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.370832 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:31.371077 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.372288 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.373976 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.374765 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.376824 (+ 2059us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.376986 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.377043 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.377134 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1377,"thread_start_us":131,"threads_started":1}
I20260810 03:49:31.378063 12870 tablet_service.cc:1467] Processing CreateTablet for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c (DEFAULT_TABLE table=test-table [id=04a6830069a942bf800eee368aab0afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:31.379472 12870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:31.379360 13016 tablet_service.cc:1467] Processing CreateTablet for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c (DEFAULT_TABLE table=test-table [id=04a6830069a942bf800eee368aab0afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:31.379642 13170 tablet_service.cc:1467] Processing CreateTablet for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c (DEFAULT_TABLE table=test-table [id=04a6830069a942bf800eee368aab0afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 03:49:31.380353 13016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:31.380561 13170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:31.386956 13267 tablet_bootstrap.cc:492] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Bootstrap starting.
I20260810 03:49:31.387951 13269 tablet_bootstrap.cc:492] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc: Bootstrap starting.
I20260810 03:49:31.389082 13268 tablet_bootstrap.cc:492] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Bootstrap starting.
I20260810 03:49:31.389489 13267 tablet_bootstrap.cc:654] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:31.390065 13269 tablet_bootstrap.cc:654] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:31.390275 13267 log.cc:824] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:31.390870 13269 log.cc:824] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:31.391129 13268 tablet_bootstrap.cc:654] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:31.391954 13268 log.cc:824] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:31.392791 13267 tablet_bootstrap.cc:492] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: No bootstrap required, opened a new log
I20260810 03:49:31.393010 13267 ts_tablet_manager.cc:1397] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 03:49:31.393280 13269 tablet_bootstrap.cc:492] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc: No bootstrap required, opened a new log
I20260810 03:49:31.393527 13269 ts_tablet_manager.cc:1397] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260810 03:49:31.393827 13268 tablet_bootstrap.cc:492] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: No bootstrap required, opened a new log
I20260810 03:49:31.394013 13268 ts_tablet_manager.cc:1397] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 03:49:31.397469 13268 raft_consensus.cc:348] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.397728 13268 raft_consensus.cc:374] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:31.397593 13269 raft_consensus.cc:348] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.397571 13267 raft_consensus.cc:348] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.397790 13268 raft_consensus.cc:729] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0128951bac545aa8f7fa6085e519aeb, State: Initialized, Role: FOLLOWER
I20260810 03:49:31.397820 13269 raft_consensus.cc:374] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:31.397820 13267 raft_consensus.cc:374] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:31.397881 13269 raft_consensus.cc:729] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26fcd71d49a44a908173173f17ecbddc, State: Initialized, Role: FOLLOWER
I20260810 03:49:31.397881 13267 raft_consensus.cc:729] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab21fb5453c344d3a7d7abb448412dac, State: Initialized, Role: FOLLOWER
I20260810 03:49:31.398277 13268 consensus_queue.cc:260] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.398319 13269 consensus_queue.cc:260] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.398317 13267 consensus_queue.cc:260] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.399315 13268 ts_tablet_manager.cc:1428] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260810 03:49:31.399312 13267 ts_tablet_manager.cc:1428] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 03:49:31.399415 13269 ts_tablet_manager.cc:1428] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 03:49:31.399675 13098 heartbeater.cc:503] Master 127.22.134.254:35189 was elected leader, sending a full tablet report...
I20260810 03:49:31.399678 13249 heartbeater.cc:503] Master 127.22.134.254:35189 was elected leader, sending a full tablet report...
I20260810 03:49:31.400808 12947 heartbeater.cc:503] Master 127.22.134.254:35189 was elected leader, sending a full tablet report...
W20260810 03:49:31.424012 12948 tablet.cc:2369] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 03:49:31.581663 13250 tablet.cc:2369] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:49:31.624884 13277 raft_consensus.cc:482] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 03:49:31.625162 13277 raft_consensus.cc:504] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.626379 13277 leader_election.cc:288] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26fcd71d49a44a908173173f17ecbddc (127.22.134.193:40509), b0128951bac545aa8f7fa6085e519aeb (127.22.134.194:34369)
W20260810 03:49:31.628829 13099 tablet.cc:2369] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 03:49:31.630957 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.626814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:48063 (local address 127.22.134.194:34369)
0810 03:49:31.626949 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.626954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.627338 (+ 384us) server_negotiation.cc:407] Connection header received
0810 03:49:31.627474 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.627477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.627527 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.627634 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:31.627958 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.628426 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.629855 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.630271 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.630369 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.630410 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.630728 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.630817 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:49:31.630960 13251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.626701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:40509 (local address 127.22.134.195:35713)
0810 03:49:31.626947 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:31.626965 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:31.627097 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:31.627443 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:31.627447 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:31.627465 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:31.627599 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.627611 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.628629 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.628632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.629797 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.629813 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.630574 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.630577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.630654 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.630703 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 03:49:31.630786 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 03:49:31.630849 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":107}
I20260810 03:49:31.630980 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.626701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.194:34369 (local address 127.22.134.195:48063)
0810 03:49:31.627214 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:31.627230 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:49:31.627360 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:49:31.627677 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:49:31.627682 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:49:31.627705 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 03:49:31.627839 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.627847 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.628547 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.628552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.629713 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:49:31.629724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.630408 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.630412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:49:31.630533 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.630562 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 03:49:31.630690 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 03:49:31.630790 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":58,"thread_start_us":169,"threads_started":1}
I20260810 03:49:31.631053 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.626806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.134.195:35713 (local address 127.22.134.193:40509)
0810 03:49:31.626949 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.626954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.627051 (+ 97us) server_negotiation.cc:407] Connection header received
0810 03:49:31.627232 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.627238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.627315 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.627407 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 03:49:31.627736 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.628442 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.629941 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.630431 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.630559 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.630608 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.630824 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.630908 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:49:31.631742 12894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ea3a9c5d3c4ef1b2deba4eec87fa7c" candidate_uuid: "ab21fb5453c344d3a7d7abb448412dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26fcd71d49a44a908173173f17ecbddc" is_pre_election: true
I20260810 03:49:31.631742 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ea3a9c5d3c4ef1b2deba4eec87fa7c" candidate_uuid: "ab21fb5453c344d3a7d7abb448412dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0128951bac545aa8f7fa6085e519aeb" is_pre_election: true
I20260810 03:49:31.632072 13040 raft_consensus.cc:2454] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab21fb5453c344d3a7d7abb448412dac in term 0.
I20260810 03:49:31.632072 12894 raft_consensus.cc:2454] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab21fb5453c344d3a7d7abb448412dac in term 0.
I20260810 03:49:31.632627 13124 leader_election.cc:302] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 26fcd71d49a44a908173173f17ecbddc, ab21fb5453c344d3a7d7abb448412dac, b0128951bac545aa8f7fa6085e519aeb; no voters:
I20260810 03:49:31.632987 13277 raft_consensus.cc:2781] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 03:49:31.633147 13277 raft_consensus.cc:482] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 03:49:31.633220 13277 raft_consensus.cc:3037] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:31.634358 13277 raft_consensus.cc:504] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.634768 13277 leader_election.cc:288] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [CANDIDATE]: Term 1 election: Requested vote from peers 26fcd71d49a44a908173173f17ecbddc (127.22.134.193:40509), b0128951bac545aa8f7fa6085e519aeb (127.22.134.194:34369)
I20260810 03:49:31.635187 13040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ea3a9c5d3c4ef1b2deba4eec87fa7c" candidate_uuid: "ab21fb5453c344d3a7d7abb448412dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0128951bac545aa8f7fa6085e519aeb"
I20260810 03:49:31.635236 12894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ea3a9c5d3c4ef1b2deba4eec87fa7c" candidate_uuid: "ab21fb5453c344d3a7d7abb448412dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26fcd71d49a44a908173173f17ecbddc"
I20260810 03:49:31.635309 13040 raft_consensus.cc:3037] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:31.635399 12894 raft_consensus.cc:3037] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:31.636507 13040 raft_consensus.cc:2454] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab21fb5453c344d3a7d7abb448412dac in term 1.
I20260810 03:49:31.636629 12894 raft_consensus.cc:2454] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab21fb5453c344d3a7d7abb448412dac in term 1.
I20260810 03:49:31.636934 13120 leader_election.cc:302] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab21fb5453c344d3a7d7abb448412dac, b0128951bac545aa8f7fa6085e519aeb; no voters:
I20260810 03:49:31.637176 13277 raft_consensus.cc:2781] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:31.637426 13277 raft_consensus.cc:686] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 1 LEADER]: Becoming Leader. State: Replica: ab21fb5453c344d3a7d7abb448412dac, State: Running, Role: LEADER
I20260810 03:49:31.637770 13277 consensus_queue.cc:237] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } }
I20260810 03:49:31.641332 12727 catalog_manager.cc:5495] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac reported cstate change: term changed from 0 to 1, leader changed from <none> to ab21fb5453c344d3a7d7abb448412dac (127.22.134.195). New cstate: current_term: 1 leader_uuid: "ab21fb5453c344d3a7d7abb448412dac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab21fb5453c344d3a7d7abb448412dac" member_type: VOTER last_known_addr { host: "127.22.134.195" port: 41787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 } health_report { overall_health: UNKNOWN } } }
I20260810 03:49:31.670042 13263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.666203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.22.134.195:41787)
0810 03:49:31.666358 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:31.666362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:31.666377 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:49:31.666460 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:31.666463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:31.666520 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:31.666650 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:49:31.666921 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.667539 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.668440 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:31.668685 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:31.668878 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:31.669208 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:49:31.669661 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:49:31.669769 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:31.669862 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 03:49:31.669912 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 03:49:31.676976 13040 raft_consensus.cc:1261] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 1 FOLLOWER]: Refusing update from remote peer ab21fb5453c344d3a7d7abb448412dac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:31.676976 12894 raft_consensus.cc:1261] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 1 FOLLOWER]: Refusing update from remote peer ab21fb5453c344d3a7d7abb448412dac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:49:31.677846 13279 consensus_queue.cc:1035] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "26fcd71d49a44a908173173f17ecbddc" member_type: VOTER last_known_addr { host: "127.22.134.193" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:31.678114 13277 consensus_queue.cc:1035] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0128951bac545aa8f7fa6085e519aeb" member_type: VOTER last_known_addr { host: "127.22.134.194" port: 34369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:49:31.689069 13282 mvcc.cc:205] Tried to move back new op lower bound from 7316823128779718656 to 7316823128631164928. Current Snapshot: MvccSnapshot[applied={T|T < 7316823128779718656}]
I20260810 03:49:31.697098 12727 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:31.697310 12727 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 03:49:31.700227 12727 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3d697c94a3ce4961ac79d481c388c101: Sending DeleteTablet for 3 replicas of tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c
I20260810 03:49:31.701313 13016 tablet_service.cc:1514] Processing DeleteTablet for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:31 UTC) from {username='slave'} at 127.0.0.1:50456
I20260810 03:49:31.701328 12870 tablet_service.cc:1514] Processing DeleteTablet for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:31 UTC) from {username='slave'} at 127.0.0.1:43954
I20260810 03:49:31.701956 13170 tablet_service.cc:1514] Processing DeleteTablet for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 03:49:31 UTC) from {username='slave'} at 127.0.0.1:45778
I20260810 03:49:31.702536 13296 tablet_replica.cc:330] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: stopping tablet replica
I20260810 03:49:31.702698 13294 tablet_replica.cc:330] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc: stopping tablet replica
I20260810 03:49:31.702950 13296 raft_consensus.cc:2229] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 1 LEADER]: Raft consensus shutting down.
I20260810 03:49:31.702970 13294 raft_consensus.cc:2229] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:31.703333 13294 raft_consensus.cc:2258] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P 26fcd71d49a44a908173173f17ecbddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:31.703609 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 12800
I20260810 03:49:31.705148 13295 tablet_replica.cc:330] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: stopping tablet replica
I20260810 03:49:31.705613 13295 raft_consensus.cc:2229] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 03:49:31.706089 13295 raft_consensus.cc:2258] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:31.708447 13295 ts_tablet_manager.cc:1905] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:31.709350 13296 raft_consensus.cc:2258] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 03:49:31.711647 13296 ts_tablet_manager.cc:1905] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 03:49:31.711916 13295 ts_tablet_manager.cc:1918] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:31.712098 13295 log.cc:1196] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-1/wal/wals/d3ea3a9c5d3c4ef1b2deba4eec87fa7c
I20260810 03:49:31.712617 13295 ts_tablet_manager.cc:1939] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P b0128951bac545aa8f7fa6085e519aeb: Deleting consensus metadata
I20260810 03:49:31.714227 12709 catalog_manager.cc:4841] TS b0128951bac545aa8f7fa6085e519aeb (127.22.134.194:34369): tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c (table test-table [id=04a6830069a942bf800eee368aab0afd]) successfully deleted
I20260810 03:49:31.715631 13296 ts_tablet_manager.cc:1918] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 03:49:31.715759 13296 log.cc:1196] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Deleting WAL directory at /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786333502007595-23067-0/minicluster-data/ts-2/wal/wals/d3ea3a9c5d3c4ef1b2deba4eec87fa7c
I20260810 03:49:31.716136 13296 ts_tablet_manager.cc:1939] T d3ea3a9c5d3c4ef1b2deba4eec87fa7c P ab21fb5453c344d3a7d7abb448412dac: Deleting consensus metadata
I20260810 03:49:31.717706 12712 catalog_manager.cc:4841] TS ab21fb5453c344d3a7d7abb448412dac (127.22.134.195:41787): tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c (table test-table [id=04a6830069a942bf800eee368aab0afd]) successfully deleted
W20260810 03:49:31.718922 12713 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.134.193:40509 (error 108)
I20260810 03:49:31.719919 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 12950
I20260810 03:49:31.720192 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:31.719794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.193:40509 (local address 127.0.0.1:43956)
0810 03:49:31.719962 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 03:49:31.720063 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.193:40509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260810 03:49:31.722843 12713 catalog_manager.cc:4584] TS 26fcd71d49a44a908173173f17ecbddc (127.22.134.193:40509): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d3ea3a9c5d3c4ef1b2deba4eec87fa7c: Network error: Client connection negotiation failed: client connection to 127.22.134.193:40509: connect: Connection refused (error 111)
I20260810 03:49:31.730952 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 13102
I20260810 03:49:31.739486 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 12693
2026-08-10T03:49:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1320 ms)
[----------] 6 tests from EncryptionPolicyTest (11571 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:31 dist-test-slave-qg60 krb5kdc[13300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:31 dist-test-slave-qg60 krb5kdc[13300](info): set up 2 sockets
Aug 10 03:49:31 dist-test-slave-qg60 krb5kdc[13300](info): commencing operation
krb5kdc: starting...
W20260810 03:49:32.940997 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:33 dist-test-slave-qg60 krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:33.084980 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42475
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:33.212678 13316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:33.213002 13316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:33.213047 13316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:33.217535 13316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:33.217631 13316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:33.217654 13316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:33.217672 13316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:33.217689 13316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:33.223464 13316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42475
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:33.224639 13316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:33.225762 13316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:33.235069 13324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:33.235177 13322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:33.235237 13316 server_base.cc:1034] running on GCE node
W20260810 03:49:33.235088 13321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:33.236203 13316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:33.237537 13316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:33.238744 13316 hybrid_clock.cc:648] HybridClock initialized: now 1786333773238709 us; error 52 us; skew 500 ppm
Aug 10 03:49:33 dist-test-slave-qg60 krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333773, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:33.241878 13316 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:33.242821 13316 webserver.cc:460] Webserver started at http://127.0.0.1:43843/ using document root <none> and password file <none>
I20260810 03:49:33.243382 13316 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:33.243443 13316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:33.243634 13316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:33.245873 13316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "42824dd3a62e486abf980dc76eabe90e"
format_stamp: "Formatted at 2026-08-10 03:49:33 on dist-test-slave-qg60"
server_key: "cb2ec2adf5a8cff1632b5b7c2e7dff4f"
server_key_iv: "62d2aead01844871dc0b856247987fb6"
server_key_version: "encryptionkey@0"
I20260810 03:49:33.246449 13316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "42824dd3a62e486abf980dc76eabe90e"
format_stamp: "Formatted at 2026-08-10 03:49:33 on dist-test-slave-qg60"
server_key: "cb2ec2adf5a8cff1632b5b7c2e7dff4f"
server_key_iv: "62d2aead01844871dc0b856247987fb6"
server_key_version: "encryptionkey@0"
I20260810 03:49:33.250499 13316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:33.253142 13332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:33.254653 13316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:49:33.254776 13316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "42824dd3a62e486abf980dc76eabe90e"
format_stamp: "Formatted at 2026-08-10 03:49:33 on dist-test-slave-qg60"
server_key: "cb2ec2adf5a8cff1632b5b7c2e7dff4f"
server_key_iv: "62d2aead01844871dc0b856247987fb6"
server_key_version: "encryptionkey@0"
I20260810 03:49:33.254879 13316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:33.270125 13316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:33.273792 13316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:33.273974 13316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:33.282514 13316 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42475
I20260810 03:49:33.282546 13390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42475 every 8 connection(s)
I20260810 03:49:33.283682 13316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:33.286600 13391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:33.292392 13391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e: Bootstrap starting.
I20260810 03:49:33.293509 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 13316
I20260810 03:49:33.293633 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:33.293953 23067 external_mini_cluster.cc:1428] Setting key e104e887df82e5db490171560457d565
I20260810 03:49:33.295449 13391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:33.296412 13391 log.cc:824] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:33.298887 13391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e: No bootstrap required, opened a new log
I20260810 03:49:33.303305 13391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42824dd3a62e486abf980dc76eabe90e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } }
I20260810 03:49:33.303615 13391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:33.303710 13391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42824dd3a62e486abf980dc76eabe90e, State: Initialized, Role: FOLLOWER
Aug 10 03:49:33 dist-test-slave-qg60 krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 03:49:33.304368 13391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42824dd3a62e486abf980dc76eabe90e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } }
I20260810 03:49:33.304539 13391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:33.304613 13391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:33.304718 13391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:33.305863 13391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42824dd3a62e486abf980dc76eabe90e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } }
I20260810 03:49:33.306326 13391 leader_election.cc:302] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42824dd3a62e486abf980dc76eabe90e; no voters:
I20260810 03:49:33.306751 13391 leader_election.cc:288] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:33.306870 13399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:33.307150 13399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [term 1 LEADER]: Becoming Leader. State: Replica: 42824dd3a62e486abf980dc76eabe90e, State: Running, Role: LEADER
I20260810 03:49:33.307552 13399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42824dd3a62e486abf980dc76eabe90e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } }
I20260810 03:49:33.308259 13391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:33.309552 13403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42824dd3a62e486abf980dc76eabe90e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42824dd3a62e486abf980dc76eabe90e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } } }
I20260810 03:49:33.309686 13403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:33.310103 13401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42824dd3a62e486abf980dc76eabe90e. Latest consensus state: current_term: 1 leader_uuid: "42824dd3a62e486abf980dc76eabe90e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42824dd3a62e486abf980dc76eabe90e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } } }
I20260810 03:49:33.310264 13401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:33.311973 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:33.295303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43387 (local address 127.0.0.1:42475)
0810 03:49:33.295846 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:33.295867 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:33.295911 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:49:33.296927 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:33.296947 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:33.297334 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:33.297741 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:33.298458 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:33.299919 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:33.300867 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:33.301643 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:33.301853 (+ 210us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:33.305013 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:33.305018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:33.305032 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:33.305066 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:33.307493 (+ 2427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:33.308216 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:33.308222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:33.308228 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:33.308383 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:33.308791 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:33.308795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:33.308797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:33.309421 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:33.309660 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:33.310682 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0810 03:49:33.310970 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":178,"threads_started":1}
W20260810 03:49:33.314030 13417 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:49:33.314126 13417 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:49:33.314229 13410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:33.315160 13410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:33.315982 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:33.321688 13410 catalog_manager.cc:1347] Generated new cluster ID: 65d798a8bf654d3399e787c8bccad1fa
I20260810 03:49:33.321767 13410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:33.328474 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:33.318433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34235 (local address 127.0.0.1:42475)
0810 03:49:33.318559 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:33.318566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:33.318851 (+ 285us) server_negotiation.cc:407] Connection header received
0810 03:49:33.318977 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:33.318980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:33.319042 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:33.319141 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:33.320133 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:33.320834 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:33.321978 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:33.322533 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:33.322681 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:33.324449 (+ 1768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:33.324453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:33.324456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:33.324485 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:33.326331 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:33.326965 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:33.326969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:33.326971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:33.327073 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:33.327431 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:33.327435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:33.327436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:33.327708 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:33.327893 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:33.328171 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 03:49:33.328287 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 03:49:33.335404 13410 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:33.336422 13410 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:33.345165 13410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42824dd3a62e486abf980dc76eabe90e: Generated new TSK 0
I20260810 03:49:33.346171 13410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:33.358348 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 13316
W20260810 03:49:33.367393 13298 connection.cc:535] client connection to 127.0.0.1:42475 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42475): Connection reset by peer (error 104)
2026-08-10T03:49:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1617 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:33 dist-test-slave-qg60 krb5kdc[13430](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:33 dist-test-slave-qg60 krb5kdc[13430](info): set up 2 sockets
Aug 10 03:49:33 dist-test-slave-qg60 krb5kdc[13430](info): commencing operation
krb5kdc: starting...
W20260810 03:49:34.490157 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:34 dist-test-slave-qg60 krb5kdc[13430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:34.637446 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33649
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:34.768512 13445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:34.769002 13445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:34.769126 13445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:34.773806 13445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:34.773912 13445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:34.773955 13445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:34.773991 13445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:34.774024 13445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:34.779928 13445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33649
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:34.781186 13445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:34.782258 13445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:34.791778 13455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:34.791837 13452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:34.791842 13453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:34.791990 13445 server_base.cc:1034] running on GCE node
I20260810 03:49:34.792680 13445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:34.794106 13445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:34.795300 13445 hybrid_clock.cc:648] HybridClock initialized: now 1786333774795264 us; error 56 us; skew 500 ppm
Aug 10 03:49:34 dist-test-slave-qg60 krb5kdc[13430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333774, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:34.798457 13445 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:34.799464 13445 webserver.cc:460] Webserver started at http://127.0.0.1:35007/ using document root <none> and password file <none>
I20260810 03:49:34.800026 13445 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:34.800091 13445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:34.800271 13445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:34.802479 13445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "248cd89c019b4fb39bbd26af41772d94"
format_stamp: "Formatted at 2026-08-10 03:49:34 on dist-test-slave-qg60"
server_key: "009394b2f734e6026d7371f7dce53a89"
server_key_iv: "5d16772bc4613f77cb1d673cfd061316"
server_key_version: "encryptionkey@0"
I20260810 03:49:34.802989 13445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "248cd89c019b4fb39bbd26af41772d94"
format_stamp: "Formatted at 2026-08-10 03:49:34 on dist-test-slave-qg60"
server_key: "009394b2f734e6026d7371f7dce53a89"
server_key_iv: "5d16772bc4613f77cb1d673cfd061316"
server_key_version: "encryptionkey@0"
I20260810 03:49:34.806839 13445 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:34.809587 13465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:34.811105 13445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:49:34.811262 13445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "248cd89c019b4fb39bbd26af41772d94"
format_stamp: "Formatted at 2026-08-10 03:49:34 on dist-test-slave-qg60"
server_key: "009394b2f734e6026d7371f7dce53a89"
server_key_iv: "5d16772bc4613f77cb1d673cfd061316"
server_key_version: "encryptionkey@0"
I20260810 03:49:34.811399 13445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:34.843205 13445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:34.846984 13445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:34.847223 13445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:34.855341 13445 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33649
I20260810 03:49:34.855372 13523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33649 every 8 connection(s)
I20260810 03:49:34.856424 13445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:34.859403 13524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:34.865278 13524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94: Bootstrap starting.
I20260810 03:49:34.866608 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 13445
I20260810 03:49:34.866783 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:34.867108 23067 external_mini_cluster.cc:1428] Setting key 2ab9be98dd1ecc2847595bddf6cf10a3
I20260810 03:49:34.868088 13524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:34.869007 13524 log.cc:824] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:34.870947 13524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94: No bootstrap required, opened a new log
I20260810 03:49:34.874569 13524 raft_consensus.cc:348] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248cd89c019b4fb39bbd26af41772d94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33649 } }
I20260810 03:49:34.874787 13524 raft_consensus.cc:374] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:34.874822 13524 raft_consensus.cc:729] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 248cd89c019b4fb39bbd26af41772d94, State: Initialized, Role: FOLLOWER
I20260810 03:49:34.875348 13524 consensus_queue.cc:260] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248cd89c019b4fb39bbd26af41772d94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33649 } }
I20260810 03:49:34.875509 13524 raft_consensus.cc:388] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:34.875586 13524 raft_consensus.cc:482] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:34.875735 13524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:34.876663 13528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:34.868315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58753 (local address 127.0.0.1:33649)
0810 03:49:34.868895 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:34.868912 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:34.868950 (+ 38us) server_negotiation.cc:407] Connection header received
0810 03:49:34.869760 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:34.869777 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:34.870115 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:34.870465 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:34.870893 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:34.871953 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:34.872929 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:34.873411 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:34.873598 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:34.874574 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:34.874579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:34.874596 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:34.875078 (+ 482us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:34.875203 (+ 125us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:34.875227 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:34.875376 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:34.875563 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 03:49:34.875915 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":148,"threads_started":1}
I20260810 03:49:34.876669 13524 raft_consensus.cc:504] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248cd89c019b4fb39bbd26af41772d94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33649 } }
I20260810 03:49:34.877161 13524 leader_election.cc:302] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 248cd89c019b4fb39bbd26af41772d94; no voters:
I20260810 03:49:34.877537 13524 leader_election.cc:288] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:34.877611 13530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:34.877842 13530 raft_consensus.cc:686] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [term 1 LEADER]: Becoming Leader. State: Replica: 248cd89c019b4fb39bbd26af41772d94, State: Running, Role: LEADER
I20260810 03:49:34.878187 13530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248cd89c019b4fb39bbd26af41772d94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33649 } }
I20260810 03:49:34.878854 13524 sys_catalog.cc:564] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:34.879423 13530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 248cd89c019b4fb39bbd26af41772d94. Latest consensus state: current_term: 1 leader_uuid: "248cd89c019b4fb39bbd26af41772d94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248cd89c019b4fb39bbd26af41772d94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33649 } } }
I20260810 03:49:34.879602 13530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:34.879968 13531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "248cd89c019b4fb39bbd26af41772d94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248cd89c019b4fb39bbd26af41772d94" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33649 } } }
I20260810 03:49:34.880074 13538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:34.880364 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:34.880118 13531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:34.883685 13538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:34.887976 13528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:34.882779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36033 (local address 127.0.0.1:33649)
0810 03:49:34.882891 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:34.882896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:34.883337 (+ 441us) server_negotiation.cc:407] Connection header received
0810 03:49:34.883476 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:34.883479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:34.883542 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:34.883622 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:34.884324 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:34.884964 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:34.885803 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:34.886116 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:34.886217 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:34.887406 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:34.887410 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:34.887412 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:34.887428 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:34.887458 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:34.887472 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:34.887529 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:34.887784 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 03:49:34.887830 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 03:49:34.891921 13538 catalog_manager.cc:1347] Generated new cluster ID: 7fd2b03c40e245fe8a986af27f9685b3
I20260810 03:49:34.892030 13538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:34.903632 13538 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:34.904850 13538 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:34.915148 13538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 248cd89c019b4fb39bbd26af41772d94: Generated new TSK 0
I20260810 03:49:34.916024 13538 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:34.927268 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 13445
W20260810 03:49:34.935916 13428 connection.cc:535] client connection to 127.0.0.1:33649 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33649): Connection reset by peer (error 104)
2026-08-10T03:49:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1568 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:34 dist-test-slave-qg60 krb5kdc[13560](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:34 dist-test-slave-qg60 krb5kdc[13560](info): set up 2 sockets
Aug 10 03:49:34 dist-test-slave-qg60 krb5kdc[13560](info): commencing operation
krb5kdc: starting...
W20260810 03:49:36.102705 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:36 dist-test-slave-qg60 krb5kdc[13560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:36.245395 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44477
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44477
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:36.362629 13575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:36.362918 13575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:36.362962 13575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:36.366995 13575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:36.367067 13575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:36.367087 13575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:36.367103 13575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:36.367120 13575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:36.372666 13575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44477
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:36.373787 13575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:36.374807 13575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:36.383824 13580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:36.383924 13584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:36.383838 13582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:36.384058 13575 server_base.cc:1034] running on GCE node
I20260810 03:49:36.384891 13575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:36.386076 13575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:36.387288 13575 hybrid_clock.cc:648] HybridClock initialized: now 1786333776387269 us; error 33 us; skew 500 ppm
Aug 10 03:49:36 dist-test-slave-qg60 krb5kdc[13560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333776, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:36.390352 13575 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:36.391196 13575 webserver.cc:460] Webserver started at http://127.0.0.1:42781/ using document root <none> and password file <none>
I20260810 03:49:36.391722 13575 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:36.391780 13575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:36.391963 13575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:36.394116 13575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "ef50b1e9d34e48b4854f4a4acba57fa8"
format_stamp: "Formatted at 2026-08-10 03:49:36 on dist-test-slave-qg60"
server_key: "702a2876bc01fe49072042cc0b9a83bc"
server_key_iv: "e529f4d3e8688577f1ff11513d51b7cc"
server_key_version: "encryptionkey@0"
I20260810 03:49:36.394713 13575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "ef50b1e9d34e48b4854f4a4acba57fa8"
format_stamp: "Formatted at 2026-08-10 03:49:36 on dist-test-slave-qg60"
server_key: "702a2876bc01fe49072042cc0b9a83bc"
server_key_iv: "e529f4d3e8688577f1ff11513d51b7cc"
server_key_version: "encryptionkey@0"
I20260810 03:49:36.398756 13575 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:36.401240 13591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:36.402695 13575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:49:36.402894 13575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "ef50b1e9d34e48b4854f4a4acba57fa8"
format_stamp: "Formatted at 2026-08-10 03:49:36 on dist-test-slave-qg60"
server_key: "702a2876bc01fe49072042cc0b9a83bc"
server_key_iv: "e529f4d3e8688577f1ff11513d51b7cc"
server_key_version: "encryptionkey@0"
I20260810 03:49:36.403136 13575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:36.408507 13575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:36.412194 13575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:36.412453 13575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:36.420717 13575 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44477
I20260810 03:49:36.420774 13650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44477 every 8 connection(s)
I20260810 03:49:36.421818 13575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:36.423372 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 13575
I20260810 03:49:36.423523 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:36.423870 23067 external_mini_cluster.cc:1428] Setting key 5a00025c962bd4632d0a68e621b0a996
I20260810 03:49:36.425709 13651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:36.429697 13655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:36.425517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58955 (local address 127.0.0.1:44477)
0810 03:49:36.426086 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:36.426102 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:36.426139 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:49:36.426796 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:36.426812 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:36.427104 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:36.427472 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:36.428392 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:36.428396 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:36.428409 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:36.428420 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:36.428478 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:36.428498 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:36.428676 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:36.428778 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 03:49:36.428942 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":152,"threads_started":1}
I20260810 03:49:36.433055 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:36.433075 13651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8: Bootstrap starting.
I20260810 03:49:36.435806 13651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:36.436919 13651 log.cc:824] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:36.437166 13655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:36.435215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57931 (local address 127.0.0.1:44477)
0810 03:49:36.435347 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:36.435350 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:36.435514 (+ 164us) server_negotiation.cc:407] Connection header received
0810 03:49:36.435680 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:36.435682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:36.435715 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:36.435784 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:36.436625 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:36.436628 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:36.436630 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:36.436641 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:36.436692 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:36.436702 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:36.436849 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:36.436968 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 03:49:36.437002 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 03:49:36.439360 13651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8: No bootstrap required, opened a new log
I20260810 03:49:36.443725 13651 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef50b1e9d34e48b4854f4a4acba57fa8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44477 } }
I20260810 03:49:36.443984 13651 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:36.444036 13651 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef50b1e9d34e48b4854f4a4acba57fa8, State: Initialized, Role: FOLLOWER
I20260810 03:49:36.444437 13651 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef50b1e9d34e48b4854f4a4acba57fa8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44477 } }
I20260810 03:49:36.444569 13651 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:36.444612 13651 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:36.444694 13651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:36.445747 13651 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef50b1e9d34e48b4854f4a4acba57fa8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44477 } }
I20260810 03:49:36.446063 13651 leader_election.cc:302] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef50b1e9d34e48b4854f4a4acba57fa8; no voters:
I20260810 03:49:36.446347 13651 leader_election.cc:288] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:36.446563 13662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:36.446844 13662 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [term 1 LEADER]: Becoming Leader. State: Replica: ef50b1e9d34e48b4854f4a4acba57fa8, State: Running, Role: LEADER
I20260810 03:49:36.447186 13662 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef50b1e9d34e48b4854f4a4acba57fa8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44477 } }
I20260810 03:49:36.447811 13651 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:36.449175 13663 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef50b1e9d34e48b4854f4a4acba57fa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef50b1e9d34e48b4854f4a4acba57fa8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44477 } } }
I20260810 03:49:36.449335 13663 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:36.449638 13664 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef50b1e9d34e48b4854f4a4acba57fa8. Latest consensus state: current_term: 1 leader_uuid: "ef50b1e9d34e48b4854f4a4acba57fa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef50b1e9d34e48b4854f4a4acba57fa8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44477 } } }
I20260810 03:49:36.449750 13664 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:36.449772 13672 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:36.453078 13672 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:36.460543 13672 catalog_manager.cc:1347] Generated new cluster ID: 86032b6e30ca4abb81774696e2d483b1
I20260810 03:49:36.460633 13672 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:36.469805 13672 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:36.470211 13672 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:36.484361 13672 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef50b1e9d34e48b4854f4a4acba57fa8: Generated new TSK 0
I20260810 03:49:36.485271 13672 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:36.490829 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 13575
2026-08-10T03:49:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1564 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:36 dist-test-slave-qg60 krb5kdc[13686](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:36 dist-test-slave-qg60 krb5kdc[13686](info): set up 2 sockets
Aug 10 03:49:36 dist-test-slave-qg60 krb5kdc[13686](info): commencing operation
krb5kdc: starting...
W20260810 03:49:37.600586 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:37 dist-test-slave-qg60 krb5kdc[13686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:37.741348 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43155
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:37.862722 13700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:37.863073 13700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:37.863164 13700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:37.867415 13700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:37.867548 13700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:37.867592 13700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:37.867628 13700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:37.867658 13700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:37.873471 13700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:37.874657 13700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:37.875737 13700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:37.885113 13706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:37.885113 13710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:37.885169 13700 server_base.cc:1034] running on GCE node
W20260810 03:49:37.885113 13707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:37.885982 13700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:37.887241 13700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:37.888501 13700 hybrid_clock.cc:648] HybridClock initialized: now 1786333777888481 us; error 35 us; skew 500 ppm
Aug 10 03:49:37 dist-test-slave-qg60 krb5kdc[13686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333777, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:37.898141 13700 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:37.899343 13700 webserver.cc:460] Webserver started at http://127.0.0.1:37827/ using document root <none> and password file <none>
I20260810 03:49:37.900028 13700 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:37.900146 13700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:37.900465 13700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:37.902904 13700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "59c2ed3830ba4c5a946c78538d21aba3"
format_stamp: "Formatted at 2026-08-10 03:49:37 on dist-test-slave-qg60"
server_key: "bba35ab965e396c3f8870680d648827c"
server_key_iv: "87083ee26793f02f1fad26f3ada010bc"
server_key_version: "encryptionkey@0"
I20260810 03:49:37.903570 13700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "59c2ed3830ba4c5a946c78538d21aba3"
format_stamp: "Formatted at 2026-08-10 03:49:37 on dist-test-slave-qg60"
server_key: "bba35ab965e396c3f8870680d648827c"
server_key_iv: "87083ee26793f02f1fad26f3ada010bc"
server_key_version: "encryptionkey@0"
I20260810 03:49:37.907989 13700 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:49:37.911192 13718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:37.912514 13700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 03:49:37.912761 13700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "59c2ed3830ba4c5a946c78538d21aba3"
format_stamp: "Formatted at 2026-08-10 03:49:37 on dist-test-slave-qg60"
server_key: "bba35ab965e396c3f8870680d648827c"
server_key_iv: "87083ee26793f02f1fad26f3ada010bc"
server_key_version: "encryptionkey@0"
I20260810 03:49:37.912912 13700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:37.937786 13700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:37.941634 13700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:37.941900 13700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:37.950222 13700 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43155
I20260810 03:49:37.950254 13776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43155 every 8 connection(s)
I20260810 03:49:37.951315 13700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:37.954223 13777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:37.959604 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 13700
I20260810 03:49:37.959779 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:37.960060 23067 external_mini_cluster.cc:1428] Setting key 918970934fc9bce9d2ad2caafc62a856
I20260810 03:49:37.960114 13777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3: Bootstrap starting.
I20260810 03:49:37.962719 13777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:37.963517 13777 log.cc:824] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:37.965531 13777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3: No bootstrap required, opened a new log
Aug 10 03:49:37 dist-test-slave-qg60 krb5kdc[13686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 03:49:37.969254 13777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c2ed3830ba4c5a946c78538d21aba3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43155 } }
I20260810 03:49:37.969549 13777 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:37.969604 13777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59c2ed3830ba4c5a946c78538d21aba3, State: Initialized, Role: FOLLOWER
I20260810 03:49:37.970151 13777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c2ed3830ba4c5a946c78538d21aba3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43155 } }
I20260810 03:49:37.970319 13777 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:37.970396 13777 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:37.970515 13777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:37.971844 13777 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c2ed3830ba4c5a946c78538d21aba3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43155 } }
I20260810 03:49:37.972241 13777 leader_election.cc:302] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59c2ed3830ba4c5a946c78538d21aba3; no voters:
I20260810 03:49:37.972608 13777 leader_election.cc:288] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:37.972764 13782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:37.973042 13782 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [term 1 LEADER]: Becoming Leader. State: Replica: 59c2ed3830ba4c5a946c78538d21aba3, State: Running, Role: LEADER
I20260810 03:49:37.973513 13782 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c2ed3830ba4c5a946c78538d21aba3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43155 } }
I20260810 03:49:37.974056 13777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:37.974799 13782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59c2ed3830ba4c5a946c78538d21aba3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c2ed3830ba4c5a946c78538d21aba3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43155 } } }
I20260810 03:49:37.975016 13782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:37.975523 13794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:37.976155 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:37.961602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51991 (local address 127.0.0.1:43155)
0810 03:49:37.962161 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:37.962178 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:37.962214 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:49:37.962932 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:37.962951 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:37.963295 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:37.963635 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:37.964569 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:37.965672 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:37.966588 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:37.967081 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:37.967264 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:37.970207 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:37.970213 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:37.970230 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:37.970266 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:37.972392 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:37.973083 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:37.973089 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:37.973095 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:37.973264 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:37.973603 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:37.973607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:37.973609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:37.974164 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:37.974348 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:37.974700 (+ 352us) server_negotiation.cc:299] Negotiation successful
0810 03:49:37.975038 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":160,"threads_started":1}
I20260810 03:49:37.975358 13782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59c2ed3830ba4c5a946c78538d21aba3. Latest consensus state: current_term: 1 leader_uuid: "59c2ed3830ba4c5a946c78538d21aba3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c2ed3830ba4c5a946c78538d21aba3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43155 } } }
I20260810 03:49:37.976249 13782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:37.979061 13794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:37.979841 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:37.985565 13794 catalog_manager.cc:1347] Generated new cluster ID: 167bd85e39704f20bfc1cbaa6c0ef208
I20260810 03:49:37.985644 13794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:37.992015 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:37.982374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59231 (local address 127.0.0.1:43155)
0810 03:49:37.982500 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:37.982504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:37.982668 (+ 164us) server_negotiation.cc:407] Connection header received
0810 03:49:37.982771 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:37.982774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:37.982824 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:37.982913 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:37.983801 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:37.984612 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:37.985905 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:37.986254 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:37.986376 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:37.988121 (+ 1745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:37.988125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:37.988128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:37.988155 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:37.990046 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:37.990560 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:37.990564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:37.990566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:37.990652 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:37.990963 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:37.990966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:37.990968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:37.991182 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:37.991310 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:37.991580 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 03:49:37.991700 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 03:49:38.012527 13794 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:38.014057 13794 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:38.028601 13794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59c2ed3830ba4c5a946c78538d21aba3: Generated new TSK 0
I20260810 03:49:38.029593 13794 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:38.040016 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 13700
2026-08-10T03:49:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1549 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:38 dist-test-slave-qg60 krb5kdc[13813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:38 dist-test-slave-qg60 krb5kdc[13813](info): set up 2 sockets
Aug 10 03:49:38 dist-test-slave-qg60 krb5kdc[13813](info): commencing operation
krb5kdc: starting...
W20260810 03:49:39.221714 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:39 dist-test-slave-qg60 krb5kdc[13813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:39.366508 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41461
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:39.486186 13828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:39.486505 13828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:39.486585 13828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:39.490816 13828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:39.490914 13828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:39.490959 13828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:39.490991 13828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:39.491022 13828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:39.496495 13828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41461
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:39.497700 13828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:39.498765 13828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:39.507975 13836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:39.507990 13838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:39.508107 13828 server_base.cc:1034] running on GCE node
W20260810 03:49:39.507983 13835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:39.508872 13828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:39.510061 13828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:39.511271 13828 hybrid_clock.cc:648] HybridClock initialized: now 1786333779511237 us; error 47 us; skew 500 ppm
Aug 10 03:49:39 dist-test-slave-qg60 krb5kdc[13813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333779, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:39.514434 13828 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:39.515358 13828 webserver.cc:460] Webserver started at http://127.0.0.1:33613/ using document root <none> and password file <none>
I20260810 03:49:39.515964 13828 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:39.516027 13828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:39.516219 13828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:39.518401 13828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "94ae2b24c28a4cf4954b630b19456829"
format_stamp: "Formatted at 2026-08-10 03:49:39 on dist-test-slave-qg60"
server_key: "6a81c8f9bfe676af44fd1d5a78032334"
server_key_iv: "6bb2c8e98783ae1ff81e702a75b833b5"
server_key_version: "encryptionkey@0"
I20260810 03:49:39.518934 13828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "94ae2b24c28a4cf4954b630b19456829"
format_stamp: "Formatted at 2026-08-10 03:49:39 on dist-test-slave-qg60"
server_key: "6a81c8f9bfe676af44fd1d5a78032334"
server_key_iv: "6bb2c8e98783ae1ff81e702a75b833b5"
server_key_version: "encryptionkey@0"
I20260810 03:49:39.523499 13828 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 03:49:39.526384 13845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:39.527765 13828 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:49:39.527921 13828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "94ae2b24c28a4cf4954b630b19456829"
format_stamp: "Formatted at 2026-08-10 03:49:39 on dist-test-slave-qg60"
server_key: "6a81c8f9bfe676af44fd1d5a78032334"
server_key_iv: "6bb2c8e98783ae1ff81e702a75b833b5"
server_key_version: "encryptionkey@0"
I20260810 03:49:39.528044 13828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:39.558233 13828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:39.561674 13828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:39.561893 13828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:39.569854 13828 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41461
I20260810 03:49:39.569880 13904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41461 every 8 connection(s)
I20260810 03:49:39.570906 13828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:39.573992 13905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:39.575778 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 13828
I20260810 03:49:39.575933 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:39.576298 23067 external_mini_cluster.cc:1428] Setting key 40abe2d395cc5c856ed737705229091e
I20260810 03:49:39.581306 13905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829: Bootstrap starting.
I20260810 03:49:39.583913 13905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:39.584789 13905 log.cc:824] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:39.585739 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:39.577920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43573 (local address 127.0.0.1:41461)
0810 03:49:39.578429 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:39.578445 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:39.578482 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:49:39.579118 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:39.579136 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:39.579472 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:39.579825 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:39.580241 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:39.581313 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:39.582243 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:39.582717 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:39.582896 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:39.583812 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:39.583817 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:39.583829 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:39.584263 (+ 434us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:39.584317 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:39.584340 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:39.584456 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:39.584596 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 03:49:39.584832 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":161,"threads_started":1}
I20260810 03:49:39.586953 13905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829: No bootstrap required, opened a new log
I20260810 03:49:39.588577 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:39.591459 13905 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ae2b24c28a4cf4954b630b19456829" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } }
I20260810 03:49:39.591755 13905 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:39.591847 13905 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ae2b24c28a4cf4954b630b19456829, State: Initialized, Role: FOLLOWER
I20260810 03:49:39.592437 13905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ae2b24c28a4cf4954b630b19456829" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } }
I20260810 03:49:39.592633 13905 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:39.592712 13905 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:39.592850 13905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:39.594167 13905 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ae2b24c28a4cf4954b630b19456829" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } }
I20260810 03:49:39.594619 13905 leader_election.cc:302] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94ae2b24c28a4cf4954b630b19456829; no voters:
I20260810 03:49:39.595095 13905 leader_election.cc:288] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:39.595192 13915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:39.595465 13915 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [term 1 LEADER]: Becoming Leader. State: Replica: 94ae2b24c28a4cf4954b630b19456829, State: Running, Role: LEADER
I20260810 03:49:39.595505 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:39.590684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39669 (local address 127.0.0.1:41461)
0810 03:49:39.590837 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:39.590841 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:39.590954 (+ 113us) server_negotiation.cc:407] Connection header received
0810 03:49:39.591105 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:39.591107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:39.591146 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:39.591205 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:39.591529 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:39.592184 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:39.593442 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:39.593697 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:39.593782 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:39.594757 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:39.594760 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:39.594762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:39.594774 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:39.594828 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:39.594846 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:39.594913 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:39.595104 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 03:49:39.595183 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:49:39.595966 13915 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ae2b24c28a4cf4954b630b19456829" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } }
I20260810 03:49:39.596589 13905 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:39.597404 13915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94ae2b24c28a4cf4954b630b19456829. Latest consensus state: current_term: 1 leader_uuid: "94ae2b24c28a4cf4954b630b19456829" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ae2b24c28a4cf4954b630b19456829" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } } }
I20260810 03:49:39.597630 13915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:39.597869 13916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94ae2b24c28a4cf4954b630b19456829" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94ae2b24c28a4cf4954b630b19456829" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } } }
I20260810 03:49:39.597993 13916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829 [sys.catalog]: This master's current role is: LEADER
W20260810 03:49:39.601852 13931 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:49:39.601951 13931 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:49:39.602027 13924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:39.602737 13924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:39.608672 13924 catalog_manager.cc:1347] Generated new cluster ID: 5d27e3b657194a10bdd3c4b5c9e47376
I20260810 03:49:39.608765 13924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:39.617411 13924 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:39.618782 13924 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:39.629156 13924 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94ae2b24c28a4cf4954b630b19456829: Generated new TSK 0
I20260810 03:49:39.630088 13924 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:39.634153 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 13828
2026-08-10T03:49:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1592 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:39 dist-test-slave-qg60 krb5kdc[13938](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:39 dist-test-slave-qg60 krb5kdc[13938](info): set up 2 sockets
Aug 10 03:49:39 dist-test-slave-qg60 krb5kdc[13938](info): commencing operation
krb5kdc: starting...
W20260810 03:49:40.768358 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:40 dist-test-slave-qg60 krb5kdc[13938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:40.921875 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34179
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:41.046170 13951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:41.046468 13951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:41.046512 13951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:41.050999 13951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:41.051084 13951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:41.051105 13951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:41.051122 13951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:41.051138 13951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:41.056995 13951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:41.058225 13951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:41.059407 13951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:41.068671 13957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:41.068660 13956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:41.068902 13951 server_base.cc:1034] running on GCE node
W20260810 03:49:41.069075 13959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:41.069730 13951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:41.070909 13951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:41.072119 13951 hybrid_clock.cc:648] HybridClock initialized: now 1786333781072088 us; error 52 us; skew 500 ppm
Aug 10 03:49:41 dist-test-slave-qg60 krb5kdc[13938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333781, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:41.075320 13951 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:41.076594 13951 webserver.cc:460] Webserver started at http://127.0.0.1:46481/ using document root <none> and password file <none>
I20260810 03:49:41.077378 13951 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:41.077478 13951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:41.077755 13951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:41.080976 13951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "2cc2ef0e2a9d4909b8d058bda80b4560"
format_stamp: "Formatted at 2026-08-10 03:49:41 on dist-test-slave-qg60"
server_key: "74c49e716c7afdb6513fefb141fcf3c2"
server_key_iv: "0c604eae7534faa57745ef3671bb7060"
server_key_version: "encryptionkey@0"
I20260810 03:49:41.081785 13951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "2cc2ef0e2a9d4909b8d058bda80b4560"
format_stamp: "Formatted at 2026-08-10 03:49:41 on dist-test-slave-qg60"
server_key: "74c49e716c7afdb6513fefb141fcf3c2"
server_key_iv: "0c604eae7534faa57745ef3671bb7060"
server_key_version: "encryptionkey@0"
I20260810 03:49:41.087252 13951 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260810 03:49:41.090577 13967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:41.091908 13951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:49:41.092078 13951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "2cc2ef0e2a9d4909b8d058bda80b4560"
format_stamp: "Formatted at 2026-08-10 03:49:41 on dist-test-slave-qg60"
server_key: "74c49e716c7afdb6513fefb141fcf3c2"
server_key_iv: "0c604eae7534faa57745ef3671bb7060"
server_key_version: "encryptionkey@0"
I20260810 03:49:41.092206 13951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:41.097301 13951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:41.100890 13951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:41.101110 13951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:41.109222 13951 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34179
I20260810 03:49:41.109298 14029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34179 every 8 connection(s)
I20260810 03:49:41.110333 13951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:41.114436 14031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:41.119966 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 13951
I20260810 03:49:41.120138 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:41.120426 23067 external_mini_cluster.cc:1428] Setting key 5eeeb45b4650d79c7b15c59b6bd6d9e8
I20260810 03:49:41.124509 14031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560: Bootstrap starting.
I20260810 03:49:41.126291 14034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:41.122020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48475 (local address 127.0.0.1:34179)
0810 03:49:41.122472 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:41.122488 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:41.122524 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:49:41.123156 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:41.123175 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:41.123466 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:41.123823 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:41.124698 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:41.124704 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:41.124779 (+ 75us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:41.124797 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:41.124854 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:41.124875 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:41.125040 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:41.125166 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 03:49:41.125335 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":161,"threads_started":1}
I20260810 03:49:41.128278 14031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:41.129671 14031 log.cc:824] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:41.132982 14031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560: No bootstrap required, opened a new log
I20260810 03:49:41.134904 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:41.138396 14031 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2ef0e2a9d4909b8d058bda80b4560" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34179 } }
I20260810 03:49:41.138769 14031 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:41.138865 14031 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cc2ef0e2a9d4909b8d058bda80b4560, State: Initialized, Role: FOLLOWER
I20260810 03:49:41.139479 14034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:41.137451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52981 (local address 127.0.0.1:34179)
0810 03:49:41.137561 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:41.137565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:41.137916 (+ 351us) server_negotiation.cc:407] Connection header received
0810 03:49:41.138086 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:41.138089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:41.138136 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:41.138234 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:41.139075 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:41.139079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:41.139082 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:41.139093 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:41.139128 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:41.139145 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:41.139243 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:41.139315 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 03:49:41.139357 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 03:49:41.139429 14031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2ef0e2a9d4909b8d058bda80b4560" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34179 } }
I20260810 03:49:41.139640 14031 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:41.139756 14031 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:41.139878 14031 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:41.141217 14031 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2ef0e2a9d4909b8d058bda80b4560" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34179 } }
I20260810 03:49:41.141633 14031 leader_election.cc:302] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cc2ef0e2a9d4909b8d058bda80b4560; no voters:
I20260810 03:49:41.142025 14031 leader_election.cc:288] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:41.142239 14043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:41.142496 14043 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [term 1 LEADER]: Becoming Leader. State: Replica: 2cc2ef0e2a9d4909b8d058bda80b4560, State: Running, Role: LEADER
I20260810 03:49:41.142851 14043 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2ef0e2a9d4909b8d058bda80b4560" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34179 } }
I20260810 03:49:41.143628 14031 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:41.144910 14044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cc2ef0e2a9d4909b8d058bda80b4560" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2ef0e2a9d4909b8d058bda80b4560" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34179 } } }
I20260810 03:49:41.145054 14044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:41.145362 14045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cc2ef0e2a9d4909b8d058bda80b4560. Latest consensus state: current_term: 1 leader_uuid: "2cc2ef0e2a9d4909b8d058bda80b4560" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cc2ef0e2a9d4909b8d058bda80b4560" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34179 } } }
I20260810 03:49:41.145450 14045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:41.145494 14054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:41.148332 14054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:41.153753 14054 catalog_manager.cc:1347] Generated new cluster ID: b2d28044abdb4f1f9286490d240c9bc2
I20260810 03:49:41.153836 14054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:41.175629 14054 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:41.176059 14054 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:41.184001 14054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cc2ef0e2a9d4909b8d058bda80b4560: Generated new TSK 0
I20260810 03:49:41.184965 14054 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:41.199085 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 13951
2026-08-10T03:49:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1564 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:41 dist-test-slave-qg60 krb5kdc[14069](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:41 dist-test-slave-qg60 krb5kdc[14069](info): set up 2 sockets
Aug 10 03:49:41 dist-test-slave-qg60 krb5kdc[14069](info): commencing operation
krb5kdc: starting...
W20260810 03:49:42.315276 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:42 dist-test-slave-qg60 krb5kdc[14069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:42.460246 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46401
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:42.576900 14084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:42.577199 14084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:42.577242 14084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:42.581404 14084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:42.581491 14084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:42.581512 14084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:42.581529 14084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:42.581545 14084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:42.587453 14084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:42.588636 14084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:42.589754 14084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:42.598707 14094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:42.598724 14090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:42.598949 14084 server_base.cc:1034] running on GCE node
W20260810 03:49:42.598742 14091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:42.599808 14084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:42.601012 14084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:42.602217 14084 hybrid_clock.cc:648] HybridClock initialized: now 1786333782602197 us; error 34 us; skew 500 ppm
Aug 10 03:49:42 dist-test-slave-qg60 krb5kdc[14069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333782, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:42.605237 14084 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:42.606173 14084 webserver.cc:460] Webserver started at http://127.0.0.1:39777/ using document root <none> and password file <none>
I20260810 03:49:42.606715 14084 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:42.606776 14084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:42.606945 14084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:42.609241 14084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "c6f065182ac540888c3e8b680c731156"
format_stamp: "Formatted at 2026-08-10 03:49:42 on dist-test-slave-qg60"
server_key: "15b01efba83050742626a210fd6ec71c"
server_key_iv: "b94ac67d0681ede0afb5dcda82d32333"
server_key_version: "encryptionkey@0"
I20260810 03:49:42.609855 14084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "c6f065182ac540888c3e8b680c731156"
format_stamp: "Formatted at 2026-08-10 03:49:42 on dist-test-slave-qg60"
server_key: "15b01efba83050742626a210fd6ec71c"
server_key_iv: "b94ac67d0681ede0afb5dcda82d32333"
server_key_version: "encryptionkey@0"
I20260810 03:49:42.613823 14084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:49:42.616386 14101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:42.618121 14084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:49:42.618268 14084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "c6f065182ac540888c3e8b680c731156"
format_stamp: "Formatted at 2026-08-10 03:49:42 on dist-test-slave-qg60"
server_key: "15b01efba83050742626a210fd6ec71c"
server_key_iv: "b94ac67d0681ede0afb5dcda82d32333"
server_key_version: "encryptionkey@0"
I20260810 03:49:42.618384 14084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:42.668797 14084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:42.672572 14084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:42.672840 14084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:42.680724 14084 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46401
I20260810 03:49:42.680783 14164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46401 every 8 connection(s)
I20260810 03:49:42.681766 14084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:42.684696 14166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:42.688661 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 14084
I20260810 03:49:42.688858 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:42.689198 23067 external_mini_cluster.cc:1428] Setting key 3f9a34d1821a7a5e0c0c883ad744ed36
I20260810 03:49:42.691267 14166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156: Bootstrap starting.
I20260810 03:49:42.693740 14166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:42.694550 14166 log.cc:824] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:42.696604 14166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156: No bootstrap required, opened a new log
Aug 10 03:49:42 dist-test-slave-qg60 krb5kdc[14069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 03:49:42.700996 14166 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f065182ac540888c3e8b680c731156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46401 } }
I20260810 03:49:42.701279 14166 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:42.701372 14166 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f065182ac540888c3e8b680c731156, State: Initialized, Role: FOLLOWER
I20260810 03:49:42.701922 14166 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f065182ac540888c3e8b680c731156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46401 } }
I20260810 03:49:42.702111 14166 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:42.702208 14166 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:42.702319 14166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:42.703392 14166 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f065182ac540888c3e8b680c731156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46401 } }
I20260810 03:49:42.703758 14166 leader_election.cc:302] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6f065182ac540888c3e8b680c731156; no voters:
I20260810 03:49:42.704125 14166 leader_election.cc:288] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:42.704257 14172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:42.704312 14169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:42.690753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:37799 (local address 127.0.0.1:46401)
0810 03:49:42.691261 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:42.691276 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:42.691312 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:49:42.691985 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:42.692002 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:42.692351 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:42.692701 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:42.693598 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:42.694660 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:42.695553 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:42.696025 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:42.696228 (+ 203us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:42.698952 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:42.698957 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:42.698972 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:42.699000 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:42.700957 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:42.701506 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:42.701512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:42.701524 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:42.701640 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:42.702005 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:42.702011 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:42.702013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:42.702627 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:42.702865 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:42.703157 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 03:49:42.703384 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":155,"threads_started":1}
I20260810 03:49:42.704469 14172 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [term 1 LEADER]: Becoming Leader. State: Replica: c6f065182ac540888c3e8b680c731156, State: Running, Role: LEADER
I20260810 03:49:42.704825 14172 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f065182ac540888c3e8b680c731156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46401 } }
I20260810 03:49:42.705601 14166 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:42.705986 14175 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6f065182ac540888c3e8b680c731156. Latest consensus state: current_term: 1 leader_uuid: "c6f065182ac540888c3e8b680c731156" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f065182ac540888c3e8b680c731156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46401 } } }
I20260810 03:49:42.706187 14175 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:42.706753 14177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:42.707715 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:42.708113 14173 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6f065182ac540888c3e8b680c731156" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f065182ac540888c3e8b680c731156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46401 } } }
I20260810 03:49:42.708209 14173 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:42.710888 14177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:42.718506 14177 catalog_manager.cc:1347] Generated new cluster ID: 79d511bf1ee34020b688b406bf0843fe
I20260810 03:49:42.718601 14177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:42.723728 14169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:42.710119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:56873 (local address 127.0.0.1:46401)
0810 03:49:42.710236 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:42.710240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:42.713979 (+ 3739us) server_negotiation.cc:407] Connection header received
0810 03:49:42.714156 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:42.714159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:42.714215 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:42.714315 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:42.715340 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:42.716004 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:42.717127 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:42.717385 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:42.717513 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:42.719351 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:42.719358 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:42.719362 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:42.719393 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:42.721416 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:42.722040 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:42.722053 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:42.722055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:42.722162 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:42.722591 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:42.722594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:42.722597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:42.722952 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:42.723140 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:42.723420 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 03:49:42.723539 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:49:42.737358 14177 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:42.738330 14177 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:42.747539 14177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6f065182ac540888c3e8b680c731156: Generated new TSK 0
I20260810 03:49:42.748541 14177 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:42.756289 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 14084
W20260810 03:49:42.766376 14067 connection.cc:535] client connection to 127.0.0.1:46401 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46401): Connection reset by peer (error 104)
2026-08-10T03:49:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1559 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:42 dist-test-slave-qg60 krb5kdc[14203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:42 dist-test-slave-qg60 krb5kdc[14203](info): set up 2 sockets
Aug 10 03:49:42 dist-test-slave-qg60 krb5kdc[14203](info): commencing operation
krb5kdc: starting...
W20260810 03:49:43.900652 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:43 dist-test-slave-qg60 krb5kdc[14203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:44.041949 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36367
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:44.162369 14220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:44.162724 14220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:44.162815 14220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:44.167104 14220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:44.167243 14220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:44.167280 14220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:44.167320 14220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:44.167348 14220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:44.173171 14220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:44.174399 14220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:44.175474 14220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:44.185194 14228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:44.185215 14226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:44.185560 14220 server_base.cc:1034] running on GCE node
W20260810 03:49:44.185636 14225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:44.186474 14220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:44.187759 14220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:44.188939 14220 hybrid_clock.cc:648] HybridClock initialized: now 1786333784188922 us; error 35 us; skew 500 ppm
Aug 10 03:49:44 dist-test-slave-qg60 krb5kdc[14203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333784, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:44.198261 14220 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:44.199357 14220 webserver.cc:460] Webserver started at http://127.0.0.1:34823/ using document root <none> and password file <none>
I20260810 03:49:44.200011 14220 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:44.200117 14220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:44.200376 14220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:44.202656 14220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "1c4dbec4d5124d27937d09eb6f7a150b"
format_stamp: "Formatted at 2026-08-10 03:49:44 on dist-test-slave-qg60"
server_key: "b4865fd0bcbc0e94ac1dd6f4927cb42b"
server_key_iv: "f60f2f13ab60f3a5ea22c40c8df63980"
server_key_version: "encryptionkey@0"
I20260810 03:49:44.203261 14220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "1c4dbec4d5124d27937d09eb6f7a150b"
format_stamp: "Formatted at 2026-08-10 03:49:44 on dist-test-slave-qg60"
server_key: "b4865fd0bcbc0e94ac1dd6f4927cb42b"
server_key_iv: "f60f2f13ab60f3a5ea22c40c8df63980"
server_key_version: "encryptionkey@0"
I20260810 03:49:44.207350 14220 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 03:49:44.210032 14236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:44.211294 14220 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:49:44.211448 14220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "1c4dbec4d5124d27937d09eb6f7a150b"
format_stamp: "Formatted at 2026-08-10 03:49:44 on dist-test-slave-qg60"
server_key: "b4865fd0bcbc0e94ac1dd6f4927cb42b"
server_key_iv: "f60f2f13ab60f3a5ea22c40c8df63980"
server_key_version: "encryptionkey@0"
I20260810 03:49:44.211575 14220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:44.229997 14220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:44.233633 14220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:44.233875 14220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:44.241807 14220 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36367
I20260810 03:49:44.241803 14296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36367 every 8 connection(s)
I20260810 03:49:44.242880 14220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:44.245880 14297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:44.250759 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 14220
I20260810 03:49:44.250913 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:44.251245 23067 external_mini_cluster.cc:1428] Setting key 9eac75fa969624be8637fcdeb8569e01
I20260810 03:49:44.252619 14297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b: Bootstrap starting.
I20260810 03:49:44.255064 14297 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:44.256111 14297 log.cc:824] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:44.258196 14297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b: No bootstrap required, opened a new log
I20260810 03:49:44.261415 14301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:44.253139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:54559 (local address 127.0.0.1:36367)
0810 03:49:44.253597 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:44.253613 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:44.253650 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:49:44.254308 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:44.254327 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:44.254678 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:44.254967 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:44.255468 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:44.256871 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:44.257798 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:44.258285 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:44.258454 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:44.259440 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:44.259445 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:44.259459 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:44.259890 (+ 431us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:44.259945 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:44.259968 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:44.260074 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:44.260345 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 03:49:44.260500 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":144,"threads_started":1}
I20260810 03:49:44.262447 14297 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4dbec4d5124d27937d09eb6f7a150b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36367 } }
I20260810 03:49:44.262713 14297 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:44.262810 14297 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c4dbec4d5124d27937d09eb6f7a150b, State: Initialized, Role: FOLLOWER
I20260810 03:49:44.263257 14297 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4dbec4d5124d27937d09eb6f7a150b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36367 } }
I20260810 03:49:44.263417 14297 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:44.263540 14297 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:44.263660 14297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:44.264834 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:44.265141 14297 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4dbec4d5124d27937d09eb6f7a150b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36367 } }
I20260810 03:49:44.265501 14297 leader_election.cc:302] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c4dbec4d5124d27937d09eb6f7a150b; no voters:
I20260810 03:49:44.265872 14297 leader_election.cc:288] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:44.265969 14303 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:44.266312 14303 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [term 1 LEADER]: Becoming Leader. State: Replica: 1c4dbec4d5124d27937d09eb6f7a150b, State: Running, Role: LEADER
I20260810 03:49:44.266670 14303 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4dbec4d5124d27937d09eb6f7a150b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36367 } }
I20260810 03:49:44.267244 14297 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:44.267959 14303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c4dbec4d5124d27937d09eb6f7a150b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4dbec4d5124d27937d09eb6f7a150b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36367 } } }
I20260810 03:49:44.268118 14303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:44.268400 14303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c4dbec4d5124d27937d09eb6f7a150b. Latest consensus state: current_term: 1 leader_uuid: "1c4dbec4d5124d27937d09eb6f7a150b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4dbec4d5124d27937d09eb6f7a150b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36367 } } }
I20260810 03:49:44.268493 14303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:44.268817 14318 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:44.272035 14301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:44.267109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:48851 (local address 127.0.0.1:36367)
0810 03:49:44.267237 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:44.267241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:44.267513 (+ 272us) server_negotiation.cc:407] Connection header received
0810 03:49:44.267656 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:44.267659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:44.267718 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:44.267810 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:44.268147 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:44.269000 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:44.270182 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:44.270511 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:44.270635 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:44.271518 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:44.271522 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:44.271525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:44.271539 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:44.271575 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:44.271588 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:44.271682 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:44.271857 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 03:49:44.271892 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 03:49:44.272475 14318 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:44.281572 14318 catalog_manager.cc:1347] Generated new cluster ID: 00d4a690e2b4482ba6c201cbd944fb13
I20260810 03:49:44.281689 14318 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:44.324083 14318 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:44.325208 14318 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:44.335021 14318 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c4dbec4d5124d27937d09eb6f7a150b: Generated new TSK 0
I20260810 03:49:44.335790 14318 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:44.344623 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 14220
W20260810 03:49:44.352859 14201 connection.cc:535] client connection to 127.0.0.1:36367 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36367): Connection reset by peer (error 104)
2026-08-10T03:49:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1585 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:44 dist-test-slave-qg60 krb5kdc[14331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:44 dist-test-slave-qg60 krb5kdc[14331](info): set up 2 sockets
Aug 10 03:49:44 dist-test-slave-qg60 krb5kdc[14331](info): commencing operation
krb5kdc: starting...
W20260810 03:49:45.459357 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:45 dist-test-slave-qg60 krb5kdc[14331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:45.609248 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45579
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:45.727216 14348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:45.727615 14348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:45.727713 14348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:45.732038 14348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:45.732168 14348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:45.732220 14348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:45.732259 14348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:45.732290 14348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:45.737947 14348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:45.739214 14348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:45.740327 14348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:45.749907 14354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:45.749899 14353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:45.749899 14356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:45.749979 14348 server_base.cc:1034] running on GCE node
I20260810 03:49:45.750795 14348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:45.752105 14348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:45.753304 14348 hybrid_clock.cc:648] HybridClock initialized: now 1786333785753283 us; error 37 us; skew 500 ppm
Aug 10 03:49:45 dist-test-slave-qg60 krb5kdc[14331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333785, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:45.756453 14348 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:45.757588 14348 webserver.cc:460] Webserver started at http://127.0.0.1:34613/ using document root <none> and password file <none>
I20260810 03:49:45.758239 14348 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:45.758337 14348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:45.758584 14348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:45.760792 14348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "cfa8ee5b6ea84e23a701934836a9e973"
format_stamp: "Formatted at 2026-08-10 03:49:45 on dist-test-slave-qg60"
server_key: "e8f6d651a9b0e68a6d2718c44c677508"
server_key_iv: "b047d08ad175398ce9c90ec4f79a7af6"
server_key_version: "encryptionkey@0"
I20260810 03:49:45.761449 14348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "cfa8ee5b6ea84e23a701934836a9e973"
format_stamp: "Formatted at 2026-08-10 03:49:45 on dist-test-slave-qg60"
server_key: "e8f6d651a9b0e68a6d2718c44c677508"
server_key_iv: "b047d08ad175398ce9c90ec4f79a7af6"
server_key_version: "encryptionkey@0"
I20260810 03:49:45.765548 14348 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 03:49:45.768141 14363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:45.769682 14348 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:49:45.769795 14348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "cfa8ee5b6ea84e23a701934836a9e973"
format_stamp: "Formatted at 2026-08-10 03:49:45 on dist-test-slave-qg60"
server_key: "e8f6d651a9b0e68a6d2718c44c677508"
server_key_iv: "b047d08ad175398ce9c90ec4f79a7af6"
server_key_version: "encryptionkey@0"
I20260810 03:49:45.769896 14348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:45.774891 14348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:45.778437 14348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:45.778606 14348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:45.786425 14348 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45579
I20260810 03:49:45.786445 14421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45579 every 8 connection(s)
I20260810 03:49:45.787448 14348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:45.790380 14422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:45.796378 14422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973: Bootstrap starting.
I20260810 03:49:45.797303 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 14348
I20260810 03:49:45.797454 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:45.797791 23067 external_mini_cluster.cc:1428] Setting key c2dcfc7b839acca0470d32ee664d5f22
I20260810 03:49:45.799647 14422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:45.800405 14422 log.cc:824] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:45.802603 14422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973: No bootstrap required, opened a new log
I20260810 03:49:45.803272 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:45.799070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:56941 (local address 127.0.0.1:45579)
0810 03:49:45.799563 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:45.799578 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:45.799615 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:49:45.800339 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:45.800358 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:45.800710 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:45.801127 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:45.801945 (+ 818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:45.801950 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:45.801962 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:45.801972 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:45.802027 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:45.802047 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:45.802180 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:45.802283 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 03:49:45.802482 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":149,"threads_started":1}
I20260810 03:49:45.806318 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:45.806726 14422 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa8ee5b6ea84e23a701934836a9e973" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45579 } }
I20260810 03:49:45.806963 14422 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:45.807044 14422 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa8ee5b6ea84e23a701934836a9e973, State: Initialized, Role: FOLLOWER
I20260810 03:49:45.807493 14422 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa8ee5b6ea84e23a701934836a9e973" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45579 } }
I20260810 03:49:45.807618 14422 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:45.807708 14422 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:45.807826 14422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:45.809240 14422 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa8ee5b6ea84e23a701934836a9e973" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45579 } }
I20260810 03:49:45.809619 14422 leader_election.cc:302] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfa8ee5b6ea84e23a701934836a9e973; no voters:
I20260810 03:49:45.809996 14422 leader_election.cc:288] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:45.810205 14435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:45.810478 14435 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [term 1 LEADER]: Becoming Leader. State: Replica: cfa8ee5b6ea84e23a701934836a9e973, State: Running, Role: LEADER
I20260810 03:49:45.810917 14435 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa8ee5b6ea84e23a701934836a9e973" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45579 } }
I20260810 03:49:45.811086 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:45.808812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:42499 (local address 127.0.0.1:45579)
0810 03:49:45.808997 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:45.809002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:45.809195 (+ 193us) server_negotiation.cc:407] Connection header received
0810 03:49:45.809396 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:45.809400 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:45.809441 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:45.809546 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:45.810454 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:45.810461 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:45.810464 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:45.810478 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:45.810511 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:45.810526 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:45.810612 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:45.810813 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 03:49:45.810861 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 03:49:45.811463 14422 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:45.812403 14435 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfa8ee5b6ea84e23a701934836a9e973. Latest consensus state: current_term: 1 leader_uuid: "cfa8ee5b6ea84e23a701934836a9e973" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa8ee5b6ea84e23a701934836a9e973" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45579 } } }
I20260810 03:49:45.812588 14435 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:45.813028 14437 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfa8ee5b6ea84e23a701934836a9e973" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfa8ee5b6ea84e23a701934836a9e973" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45579 } } }
I20260810 03:49:45.813108 14445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:45.813174 14437 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:45.816203 14445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:45.822301 14445 catalog_manager.cc:1347] Generated new cluster ID: 771e54e65ea548aea3810f01dee1f56c
I20260810 03:49:45.822387 14445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:45.847522 14445 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:45.847883 14445 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:45.853195 14445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfa8ee5b6ea84e23a701934836a9e973: Generated new TSK 0
I20260810 03:49:45.853933 14445 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:45.865506 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 14348
2026-08-10T03:49:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1522 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:45 dist-test-slave-qg60 krb5kdc[14459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:45 dist-test-slave-qg60 krb5kdc[14459](info): set up 2 sockets
Aug 10 03:49:45 dist-test-slave-qg60 krb5kdc[14459](info): commencing operation
krb5kdc: starting...
W20260810 03:49:46.985414 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:47 dist-test-slave-qg60 krb5kdc[14459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:47.126107 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:47.245676 14472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:47.246209 14472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:47.246268 14472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:47.250458 14472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:47.250537 14472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:47.250558 14472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:47.250576 14472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:47.250592 14472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:47.256248 14472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41345
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:47.257396 14472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:47.258399 14472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:47.267658 14481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:47.267663 14478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:47.267849 14472 server_base.cc:1034] running on GCE node
W20260810 03:49:47.267658 14479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:47.268858 14472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:47.270155 14472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:47.271413 14472 hybrid_clock.cc:648] HybridClock initialized: now 1786333787271376 us; error 54 us; skew 500 ppm
Aug 10 03:49:47 dist-test-slave-qg60 krb5kdc[14459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333787, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:47.275539 14472 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:47.276873 14472 webserver.cc:460] Webserver started at http://127.0.0.1:40997/ using document root <none> and password file <none>
I20260810 03:49:47.277529 14472 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:47.277642 14472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:47.277933 14472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:47.280332 14472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "ca6978cb8ad6430890d725cae38cf717"
format_stamp: "Formatted at 2026-08-10 03:49:47 on dist-test-slave-qg60"
server_key: "eff7adad332385a8999553149c6ba217"
server_key_iv: "b978bbcd1c102a8727dc8993d8a4f367"
server_key_version: "encryptionkey@0"
I20260810 03:49:47.281028 14472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "ca6978cb8ad6430890d725cae38cf717"
format_stamp: "Formatted at 2026-08-10 03:49:47 on dist-test-slave-qg60"
server_key: "eff7adad332385a8999553149c6ba217"
server_key_iv: "b978bbcd1c102a8727dc8993d8a4f367"
server_key_version: "encryptionkey@0"
I20260810 03:49:47.285636 14472 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 03:49:47.288668 14488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:47.290200 14472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 03:49:47.290397 14472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "ca6978cb8ad6430890d725cae38cf717"
format_stamp: "Formatted at 2026-08-10 03:49:47 on dist-test-slave-qg60"
server_key: "eff7adad332385a8999553149c6ba217"
server_key_iv: "b978bbcd1c102a8727dc8993d8a4f367"
server_key_version: "encryptionkey@0"
I20260810 03:49:47.290540 14472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:47.310909 14472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:47.314447 14472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:47.314688 14472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:47.322857 14472 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41345
I20260810 03:49:47.322881 14547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41345 every 8 connection(s)
I20260810 03:49:47.323863 14472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:47.324970 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 14472
I20260810 03:49:47.325147 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:47.325495 23067 external_mini_cluster.cc:1428] Setting key c5dd87871909af82b3bf793eb641883d
I20260810 03:49:47.327478 14548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:47.333985 14548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717: Bootstrap starting.
Aug 10 03:49:47 dist-test-slave-qg60 krb5kdc[14459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 03:49:47.336913 14548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:47.337772 14548 log.cc:824] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:47.340641 14548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717: No bootstrap required, opened a new log
I20260810 03:49:47.341979 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:47.327023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:36381 (local address 127.0.0.1:41345)
0810 03:49:47.327646 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:47.327668 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:47.327705 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:49:47.328383 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:47.328400 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:47.328865 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:47.329240 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:47.330096 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:47.331111 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:47.332033 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:47.332526 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:47.332720 (+ 194us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:47.335857 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:47.335862 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:47.335876 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:47.335908 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:47.337817 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:47.338510 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:47.338515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:47.338521 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:47.338857 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:47.339420 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:47.339423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:47.339425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:47.340008 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:47.340259 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:47.340631 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 03:49:47.340920 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":168,"threads_started":1}
I20260810 03:49:47.344378 14548 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca6978cb8ad6430890d725cae38cf717" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41345 } }
I20260810 03:49:47.344691 14548 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:47.344821 14548 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca6978cb8ad6430890d725cae38cf717, State: Initialized, Role: FOLLOWER
I20260810 03:49:47.345366 14548 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca6978cb8ad6430890d725cae38cf717" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41345 } }
I20260810 03:49:47.345538 14548 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:47.345616 14548 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:47.345611 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:47.345731 14548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:47.347143 14548 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca6978cb8ad6430890d725cae38cf717" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41345 } }
I20260810 03:49:47.347575 14548 leader_election.cc:302] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca6978cb8ad6430890d725cae38cf717; no voters:
I20260810 03:49:47.347954 14548 leader_election.cc:288] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:47.348066 14560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:47.348272 14560 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [term 1 LEADER]: Becoming Leader. State: Replica: ca6978cb8ad6430890d725cae38cf717, State: Running, Role: LEADER
I20260810 03:49:47.348821 14560 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca6978cb8ad6430890d725cae38cf717" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41345 } }
I20260810 03:49:47.349494 14548 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:47.350871 14561 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca6978cb8ad6430890d725cae38cf717" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca6978cb8ad6430890d725cae38cf717" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41345 } } }
I20260810 03:49:47.351085 14561 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:47.351534 14562 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca6978cb8ad6430890d725cae38cf717. Latest consensus state: current_term: 1 leader_uuid: "ca6978cb8ad6430890d725cae38cf717" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca6978cb8ad6430890d725cae38cf717" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41345 } } }
I20260810 03:49:47.351742 14562 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:47.352093 14573 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:47.355391 14573 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:47.358615 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:47.348611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:44561 (local address 127.0.0.1:41345)
0810 03:49:47.348755 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:47.348761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:47.348906 (+ 145us) server_negotiation.cc:407] Connection header received
0810 03:49:47.349136 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:47.349140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:47.349196 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:47.349287 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:47.350051 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:47.350810 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:47.351988 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:47.352328 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:47.352434 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:47.354478 (+ 2044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:47.354481 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:47.354484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:47.354511 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:47.356298 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:47.356979 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:47.356983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:47.356984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:47.357073 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:47.357481 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:47.357484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:47.357486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:47.357723 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:47.357871 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:47.358334 (+ 463us) server_negotiation.cc:299] Negotiation successful
0810 03:49:47.358451 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 03:49:47.361881 14573 catalog_manager.cc:1347] Generated new cluster ID: a7e26a0725554d00bedcfecc568ccce6
I20260810 03:49:47.361955 14573 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:47.378201 14573 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:47.379314 14573 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:47.388906 14573 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca6978cb8ad6430890d725cae38cf717: Generated new TSK 0
I20260810 03:49:47.389770 14573 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:47.394572 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 14472
W20260810 03:49:47.401940 14457 connection.cc:535] client connection to 127.0.0.1:41345 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41345): Connection reset by peer (error 104)
2026-08-10T03:49:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1526 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:47 dist-test-slave-qg60 krb5kdc[14586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:47 dist-test-slave-qg60 krb5kdc[14586](info): set up 2 sockets
Aug 10 03:49:47 dist-test-slave-qg60 krb5kdc[14586](info): commencing operation
krb5kdc: starting...
W20260810 03:49:48.537547 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:48 dist-test-slave-qg60 krb5kdc[14586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:48.680892 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33227
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:48.808676 14599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:48.809101 14599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:48.809196 14599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:48.813485 14599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:48.813593 14599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:48.813634 14599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:48.813696 14599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:48.813736 14599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:48.819413 14599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33227
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:48.820667 14599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:48.822252 14599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:48.832374 14608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:48.832391 14606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:48.832406 14605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:48.832765 14599 server_base.cc:1034] running on GCE node
I20260810 03:49:48.833381 14599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:48.834589 14599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:48.835840 14599 hybrid_clock.cc:648] HybridClock initialized: now 1786333788835818 us; error 34 us; skew 500 ppm
Aug 10 03:49:48 dist-test-slave-qg60 krb5kdc[14586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333788, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:48.839375 14599 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:48.840373 14599 webserver.cc:460] Webserver started at http://127.0.0.1:36971/ using document root <none> and password file <none>
I20260810 03:49:48.841109 14599 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:48.841214 14599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:48.841459 14599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:48.843678 14599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "0cec4595e7324c36857a2bc5fe6ae04c"
format_stamp: "Formatted at 2026-08-10 03:49:48 on dist-test-slave-qg60"
server_key: "9b6ce9200dd7e2db37289fb242654c8b"
server_key_iv: "8dc4b48a8f11b9a3c410023ad27390ed"
server_key_version: "encryptionkey@0"
I20260810 03:49:48.844277 14599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "0cec4595e7324c36857a2bc5fe6ae04c"
format_stamp: "Formatted at 2026-08-10 03:49:48 on dist-test-slave-qg60"
server_key: "9b6ce9200dd7e2db37289fb242654c8b"
server_key_iv: "8dc4b48a8f11b9a3c410023ad27390ed"
server_key_version: "encryptionkey@0"
I20260810 03:49:48.848878 14599 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.003s
I20260810 03:49:48.852097 14616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:48.853886 14599 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 03:49:48.854069 14599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "0cec4595e7324c36857a2bc5fe6ae04c"
format_stamp: "Formatted at 2026-08-10 03:49:48 on dist-test-slave-qg60"
server_key: "9b6ce9200dd7e2db37289fb242654c8b"
server_key_iv: "8dc4b48a8f11b9a3c410023ad27390ed"
server_key_version: "encryptionkey@0"
I20260810 03:49:48.854233 14599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:48.870280 14599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:48.873931 14599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:48.874208 14599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:48.882032 14599 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33227
I20260810 03:49:48.882038 14674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33227 every 8 connection(s)
I20260810 03:49:48.883052 14599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:48.886112 14675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:48.889781 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 14599
I20260810 03:49:48.889928 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:48.890234 23067 external_mini_cluster.cc:1428] Setting key b146c30a27fdc8f11d02b598684f66a1
I20260810 03:49:48.893697 14675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c: Bootstrap starting.
I20260810 03:49:48.896356 14675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:48.897271 14675 log.cc:824] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:48.899709 14675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c: No bootstrap required, opened a new log
I20260810 03:49:48.900143 14679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:48.891667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:46861 (local address 127.0.0.1:33227)
0810 03:49:48.892390 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:48.892407 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:48.892446 (+ 39us) server_negotiation.cc:407] Connection header received
0810 03:49:48.893207 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:48.893227 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:48.893593 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:48.893962 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:48.894302 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:48.895292 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:48.896563 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:48.897158 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:48.897288 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:48.898335 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:48.898340 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:48.898353 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:48.898756 (+ 403us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:48.898810 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:48.898832 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:48.898939 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:48.899154 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 03:49:48.899320 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":145,"threads_started":1}
I20260810 03:49:48.903414 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:48.904058 14675 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cec4595e7324c36857a2bc5fe6ae04c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33227 } }
I20260810 03:49:48.904313 14675 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:48.904403 14675 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cec4595e7324c36857a2bc5fe6ae04c, State: Initialized, Role: FOLLOWER
I20260810 03:49:48.904950 14675 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cec4595e7324c36857a2bc5fe6ae04c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33227 } }
I20260810 03:49:48.905141 14675 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:48.905210 14675 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:48.905310 14675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:48.906654 14675 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cec4595e7324c36857a2bc5fe6ae04c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33227 } }
I20260810 03:49:48.907065 14675 leader_election.cc:302] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cec4595e7324c36857a2bc5fe6ae04c; no voters:
I20260810 03:49:48.907444 14675 leader_election.cc:288] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:48.907567 14686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:48.907858 14686 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [term 1 LEADER]: Becoming Leader. State: Replica: 0cec4595e7324c36857a2bc5fe6ae04c, State: Running, Role: LEADER
I20260810 03:49:48.908252 14686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cec4595e7324c36857a2bc5fe6ae04c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33227 } }
I20260810 03:49:48.908928 14675 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:48.910558 14687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cec4595e7324c36857a2bc5fe6ae04c. Latest consensus state: current_term: 1 leader_uuid: "0cec4595e7324c36857a2bc5fe6ae04c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cec4595e7324c36857a2bc5fe6ae04c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33227 } } }
I20260810 03:49:48.910712 14687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:48.910895 14679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:48.905770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:46707 (local address 127.0.0.1:33227)
0810 03:49:48.905910 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:48.905914 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:48.906092 (+ 178us) server_negotiation.cc:407] Connection header received
0810 03:49:48.906183 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:48.906187 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:48.906240 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:48.906341 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:48.906546 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:48.907331 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:48.908538 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:48.908924 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:48.909062 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:48.910249 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:48.910255 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:48.910259 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:48.910280 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:48.910317 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:48.910336 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:48.910441 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:48.910696 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 03:49:48.910736 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 03:49:48.911224 14695 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:48.911440 14688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cec4595e7324c36857a2bc5fe6ae04c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cec4595e7324c36857a2bc5fe6ae04c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33227 } } }
I20260810 03:49:48.911536 14688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:48.914997 14695 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:48.921438 14695 catalog_manager.cc:1347] Generated new cluster ID: 573174c7941441148b4a199d306a967d
I20260810 03:49:48.921535 14695 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:48.945622 14695 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:48.946748 14695 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:48.952348 14695 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0cec4595e7324c36857a2bc5fe6ae04c: Generated new TSK 0
I20260810 03:49:48.953145 14695 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:48.964463 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 14599
W20260810 03:49:48.972136 14584 connection.cc:535] client connection to 127.0.0.1:33227 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33227): Connection reset by peer (error 104)
2026-08-10T03:49:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1570 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:49 dist-test-slave-qg60 krb5kdc[14708](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:49 dist-test-slave-qg60 krb5kdc[14708](info): set up 2 sockets
Aug 10 03:49:49 dist-test-slave-qg60 krb5kdc[14708](info): commencing operation
krb5kdc: starting...
W20260810 03:49:50.090582 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:50 dist-test-slave-qg60 krb5kdc[14708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 03:49:50.232273 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44427
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44427
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:50.348104 14724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:50.348470 14724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:50.348551 14724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:50.352772 14724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:50.352886 14724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:50.352926 14724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:50.352959 14724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:50.353053 14724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:50.358664 14724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44427
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:50.359859 14724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:50.361055 14724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:50.370338 14729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:50.370342 14730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:50.370342 14732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:50.370354 14724 server_base.cc:1034] running on GCE node
I20260810 03:49:50.371235 14724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:50.372388 14724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:50.373557 14724 hybrid_clock.cc:648] HybridClock initialized: now 1786333790373537 us; error 32 us; skew 500 ppm
Aug 10 03:49:50 dist-test-slave-qg60 krb5kdc[14708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333790, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:50.381098 14724 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 03:49:50.382184 14724 webserver.cc:460] Webserver started at http://127.0.0.1:39177/ using document root <none> and password file <none>
I20260810 03:49:50.382824 14724 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:50.382893 14724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:50.383126 14724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:50.385403 14724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "9b4a691949894a77adb70aa4af1957e1"
format_stamp: "Formatted at 2026-08-10 03:49:50 on dist-test-slave-qg60"
server_key: "e8c0e5a8f6d7508951b0687e48d3cfac"
server_key_iv: "2fa28ebbb79745eab63d099e786d0d39"
server_key_version: "encryptionkey@0"
I20260810 03:49:50.386021 14724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "9b4a691949894a77adb70aa4af1957e1"
format_stamp: "Formatted at 2026-08-10 03:49:50 on dist-test-slave-qg60"
server_key: "e8c0e5a8f6d7508951b0687e48d3cfac"
server_key_iv: "2fa28ebbb79745eab63d099e786d0d39"
server_key_version: "encryptionkey@0"
I20260810 03:49:50.390162 14724 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:50.392705 14739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:50.394081 14724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:49:50.394234 14724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "9b4a691949894a77adb70aa4af1957e1"
format_stamp: "Formatted at 2026-08-10 03:49:50 on dist-test-slave-qg60"
server_key: "e8c0e5a8f6d7508951b0687e48d3cfac"
server_key_iv: "2fa28ebbb79745eab63d099e786d0d39"
server_key_version: "encryptionkey@0"
I20260810 03:49:50.394354 14724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:50.399160 14724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:50.402442 14724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:50.402649 14724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:50.410374 14724 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44427
I20260810 03:49:50.410405 14798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44427 every 8 connection(s)
I20260810 03:49:50.411412 14724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:50.414368 14799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:50.419986 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 14724
I20260810 03:49:50.420101 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:50.420269 14799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1: Bootstrap starting.
I20260810 03:49:50.420437 23067 external_mini_cluster.cc:1428] Setting key c2eacf82dcfd7aa37b9a425462f9e586
I20260810 03:49:50.423032 14799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:50.423816 14799 log.cc:824] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:50.426049 14805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:50.421943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:59915 (local address 127.0.0.1:44427)
0810 03:49:50.422427 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:50.422443 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:50.422479 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:49:50.423155 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:50.423221 (+ 66us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:50.423536 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:50.423892 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:50.424772 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:50.424778 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:50.424795 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:50.424813 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:50.424868 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:50.424887 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:50.424982 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:50.425136 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 03:49:50.425326 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":149,"threads_started":1}
I20260810 03:49:50.426213 14799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1: No bootstrap required, opened a new log
I20260810 03:49:50.429100 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:50.431070 14799 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4a691949894a77adb70aa4af1957e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44427 } }
I20260810 03:49:50.431393 14799 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:50.431496 14799 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4a691949894a77adb70aa4af1957e1, State: Initialized, Role: FOLLOWER
I20260810 03:49:50.432161 14799 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4a691949894a77adb70aa4af1957e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44427 } }
I20260810 03:49:50.432350 14799 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:50.432428 14799 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:50.432545 14799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:50.433488 14805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:50.431651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:48087 (local address 127.0.0.1:44427)
0810 03:49:50.431795 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:50.431799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:50.432013 (+ 214us) server_negotiation.cc:407] Connection header received
0810 03:49:50.432101 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:50.432104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:50.432144 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:50.432238 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:50.433099 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:50.433103 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:50.433105 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:50.433117 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:50.433146 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:50.433158 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:50.433252 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:50.433327 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 03:49:50.433369 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:49:50.434307 14799 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4a691949894a77adb70aa4af1957e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44427 } }
I20260810 03:49:50.434762 14799 leader_election.cc:302] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b4a691949894a77adb70aa4af1957e1; no voters:
I20260810 03:49:50.435110 14799 leader_election.cc:288] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:50.435212 14813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:50.435480 14813 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [term 1 LEADER]: Becoming Leader. State: Replica: 9b4a691949894a77adb70aa4af1957e1, State: Running, Role: LEADER
I20260810 03:49:50.435882 14813 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4a691949894a77adb70aa4af1957e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44427 } }
I20260810 03:49:50.436458 14799 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:50.437675 14815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b4a691949894a77adb70aa4af1957e1. Latest consensus state: current_term: 1 leader_uuid: "9b4a691949894a77adb70aa4af1957e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4a691949894a77adb70aa4af1957e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44427 } } }
I20260810 03:49:50.437808 14815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:50.438130 14814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b4a691949894a77adb70aa4af1957e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4a691949894a77adb70aa4af1957e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44427 } } }
I20260810 03:49:50.438210 14822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:50.438310 14814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:50.441723 14822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:50.447465 14822 catalog_manager.cc:1347] Generated new cluster ID: 1100a0dd6e574ad6b068bdbd8b1a2ade
I20260810 03:49:50.447556 14822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:50.454010 14822 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:50.454339 14822 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:50.459373 14822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b4a691949894a77adb70aa4af1957e1: Generated new TSK 0
I20260810 03:49:50.460112 14822 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:50.471343 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 14724
2026-08-10T03:49:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1507 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:50 dist-test-slave-qg60 krb5kdc[14837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:50 dist-test-slave-qg60 krb5kdc[14837](info): set up 2 sockets
Aug 10 03:49:50 dist-test-slave-qg60 krb5kdc[14837](info): commencing operation
krb5kdc: starting...
W20260810 03:49:51.608850 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:51 dist-test-slave-qg60 krb5kdc[14837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:51.753623 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:45519
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:37215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:45519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:51.867594 14850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:51.867977 14850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:51.868044 14850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:51.872234 14850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:51.872359 14850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:51.872399 14850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:51.872435 14850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:51.872466 14850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:51.877980 14850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:37215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:45519
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:45519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:51.879153 14850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:51.880208 14850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:51.889297 14856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:51.889297 14858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:51.889384 14850 server_base.cc:1034] running on GCE node
W20260810 03:49:51.889297 14861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:51.890154 14850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:51.891337 14850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:51.892551 14850 hybrid_clock.cc:648] HybridClock initialized: now 1786333791892531 us; error 36 us; skew 500 ppm
Aug 10 03:49:51 dist-test-slave-qg60 krb5kdc[14837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333791, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:51.895949 14850 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:51.897164 14850 webserver.cc:460] Webserver started at http://127.22.134.254:33705/ using document root <none> and password file <none>
I20260810 03:49:51.897818 14850 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:51.897891 14850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:51.898152 14850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:51.900514 14850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "06005558a3f8473d9505475aa089a4a1"
format_stamp: "Formatted at 2026-08-10 03:49:51 on dist-test-slave-qg60"
server_key: "0133c65f488763c5d29d1d12d215219c"
server_key_iv: "aa66fa6e06f1980f4a2003c4b6763814"
server_key_version: "encryptionkey@0"
I20260810 03:49:51.901257 14850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "06005558a3f8473d9505475aa089a4a1"
format_stamp: "Formatted at 2026-08-10 03:49:51 on dist-test-slave-qg60"
server_key: "0133c65f488763c5d29d1d12d215219c"
server_key_iv: "aa66fa6e06f1980f4a2003c4b6763814"
server_key_version: "encryptionkey@0"
I20260810 03:49:51.905597 14850 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:51.908211 14868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:51.909664 14850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 03:49:51.909837 14850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "06005558a3f8473d9505475aa089a4a1"
format_stamp: "Formatted at 2026-08-10 03:49:51 on dist-test-slave-qg60"
server_key: "0133c65f488763c5d29d1d12d215219c"
server_key_iv: "aa66fa6e06f1980f4a2003c4b6763814"
server_key_version: "encryptionkey@0"
I20260810 03:49:51.909965 14850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:51.921248 14850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:51.924635 14850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:51.924881 14850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:51.932479 14850 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:45519
I20260810 03:49:51.932503 14924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:45519 every 8 connection(s)
I20260810 03:49:51.933589 14850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:51.936707 14925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:51.941573 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 14850
I20260810 03:49:51.941735 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:51.942067 23067 external_mini_cluster.cc:1428] Setting key 2b19ec7562ad49eff8b73738f83f0bb6
I20260810 03:49:51.943383 14925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1: Bootstrap starting.
I20260810 03:49:51.946059 14925 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:51.946885 14925 log.cc:824] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:51.949198 14925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1: No bootstrap required, opened a new log
Aug 10 03:49:51 dist-test-slave-qg60 krb5kdc[14837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:51.953759 14925 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06005558a3f8473d9505475aa089a4a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 45519 } }
I20260810 03:49:51.954049 14925 raft_consensus.cc:374] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:51.954141 14925 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06005558a3f8473d9505475aa089a4a1, State: Initialized, Role: FOLLOWER
I20260810 03:49:51.954690 14925 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06005558a3f8473d9505475aa089a4a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 45519 } }
I20260810 03:49:51.954877 14925 raft_consensus.cc:388] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:51.954960 14925 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:51.955078 14925 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:51.956164 14925 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06005558a3f8473d9505475aa089a4a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 45519 } }
I20260810 03:49:51.956621 14925 leader_election.cc:302] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06005558a3f8473d9505475aa089a4a1; no voters:
I20260810 03:49:51.957042 14925 leader_election.cc:288] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:51.957152 14932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:51.957360 14932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [term 1 LEADER]: Becoming Leader. State: Replica: 06005558a3f8473d9505475aa089a4a1, State: Running, Role: LEADER
I20260810 03:49:51.957772 14930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:51.943712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45037 (local address 127.22.134.254:45519)
0810 03:49:51.944304 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:51.944321 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:51.944361 (+ 40us) server_negotiation.cc:407] Connection header received
0810 03:49:51.945140 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:51.945158 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:51.945526 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:51.945884 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:51.946773 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:51.948027 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:51.949006 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:51.949533 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:51.949715 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:51.952356 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:51.952362 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:51.952375 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:51.952405 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:51.954373 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:51.954903 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:51.954909 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:51.954915 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:51.955083 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:51.955449 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:51.955452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:51.955454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:51.955886 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:51.956131 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:51.956413 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 03:49:51.956659 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":173,"threads_started":1}
I20260810 03:49:51.957746 14932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06005558a3f8473d9505475aa089a4a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 45519 } }
I20260810 03:49:51.958539 14925 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:51.959445 14933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06005558a3f8473d9505475aa089a4a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06005558a3f8473d9505475aa089a4a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 45519 } } }
I20260810 03:49:51.959568 14933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:51.959896 14934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06005558a3f8473d9505475aa089a4a1. Latest consensus state: current_term: 1 leader_uuid: "06005558a3f8473d9505475aa089a4a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06005558a3f8473d9505475aa089a4a1" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 45519 } } }
I20260810 03:49:51.960044 14934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:51.960347 14944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:51.962108 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:51.964250 14944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:51.970917 14944 catalog_manager.cc:1347] Generated new cluster ID: 017f22f52bc94185b62f5b57823fd65d
I20260810 03:49:51.970988 14944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:51.974913 14930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:51.964412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36913 (local address 127.22.134.254:45519)
0810 03:49:51.964546 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:51.964551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:51.965021 (+ 470us) server_negotiation.cc:407] Connection header received
0810 03:49:51.965131 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:51.965135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:51.965190 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:51.965287 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:51.966147 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:51.967041 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:51.968193 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:51.968608 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:51.968764 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:51.970823 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:51.970828 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:51.970831 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:51.970864 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:51.972826 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:51.973388 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:51.973393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:51.973395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:51.973496 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:51.973876 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:51.973880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:51.973882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:51.974144 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:51.974328 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:51.974606 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 03:49:51.974725 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 03:49:51.986003 14944 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:51.987128 14944 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:52.003602 14944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 06005558a3f8473d9505475aa089a4a1: Generated new TSK 0
I20260810 03:49:52.004448 14944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:52.012283 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 14850
W20260810 03:49:52.022439 14835 connection.cc:535] client connection to 127.22.134.254:45519 recv error: Network error: failed to read from TLS socket (remote: 127.22.134.254:45519): Connection reset by peer (error 104)
2026-08-10T03:49:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1543 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:52 dist-test-slave-qg60 krb5kdc[14964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:52 dist-test-slave-qg60 krb5kdc[14964](info): set up 2 sockets
Aug 10 03:49:52 dist-test-slave-qg60 krb5kdc[14964](info): commencing operation
krb5kdc: starting...
W20260810 03:49:53.163563 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:53 dist-test-slave-qg60 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:53.314386 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35419
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:38757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:35419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:53.431176 14978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:53.431545 14978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:53.431629 14978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:53.435807 14978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:53.435936 14978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:53.435977 14978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:53.436048 14978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:53.436089 14978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:53.441962 14978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:35419
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:53.443226 14978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:53.444309 14978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:53.453639 14985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:53.453639 14989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:53.453799 14978 server_base.cc:1034] running on GCE node
W20260810 03:49:53.453640 14986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:53.454672 14978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:53.455966 14978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:53.457175 14978 hybrid_clock.cc:648] HybridClock initialized: now 1786333793457148 us; error 46 us; skew 500 ppm
Aug 10 03:49:53 dist-test-slave-qg60 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333793, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:53.460395 14978 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:53.461467 14978 webserver.cc:460] Webserver started at http://127.22.134.254:41039/ using document root <none> and password file <none>
I20260810 03:49:53.462105 14978 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:53.462172 14978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:53.462400 14978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:53.464641 14978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "6daabd65bd4743008f61baa33aa87c68"
format_stamp: "Formatted at 2026-08-10 03:49:53 on dist-test-slave-qg60"
server_key: "5afd26c9d9c407041422b76a23647483"
server_key_iv: "4fdd8bd3eff4db72068b0a7a069bf601"
server_key_version: "encryptionkey@0"
I20260810 03:49:53.465309 14978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "6daabd65bd4743008f61baa33aa87c68"
format_stamp: "Formatted at 2026-08-10 03:49:53 on dist-test-slave-qg60"
server_key: "5afd26c9d9c407041422b76a23647483"
server_key_iv: "4fdd8bd3eff4db72068b0a7a069bf601"
server_key_version: "encryptionkey@0"
I20260810 03:49:53.469472 14978 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:53.472195 14996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:53.473695 14978 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:49:53.473861 14978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "6daabd65bd4743008f61baa33aa87c68"
format_stamp: "Formatted at 2026-08-10 03:49:53 on dist-test-slave-qg60"
server_key: "5afd26c9d9c407041422b76a23647483"
server_key_iv: "4fdd8bd3eff4db72068b0a7a069bf601"
server_key_version: "encryptionkey@0"
I20260810 03:49:53.474071 14978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:53.488612 14978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:53.492215 14978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:53.492439 14978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:53.499861 14978 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:35419
I20260810 03:49:53.499888 15056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:35419 every 8 connection(s)
I20260810 03:49:53.500914 14978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:53.502767 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 14978
I20260810 03:49:53.502928 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:53.503264 23067 external_mini_cluster.cc:1428] Setting key 70d70ce3f3ee2d2e3e089d40094e5ea9
I20260810 03:49:53.504530 15057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:53.511935 15057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68: Bootstrap starting.
I20260810 03:49:53.514039 15061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:53.504921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50655 (local address 127.22.134.254:35419)
0810 03:49:53.505492 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:53.505515 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:53.505565 (+ 50us) server_negotiation.cc:407] Connection header received
0810 03:49:53.506254 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:53.506271 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:53.506620 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:53.506906 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:53.507397 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:53.508480 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:53.509964 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:53.510450 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:53.510590 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:53.511724 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:53.511729 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:53.511744 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:53.512423 (+ 679us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:53.512494 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:53.512526 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:53.512665 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:53.512928 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 03:49:53.513204 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":177,"threads_started":1}
I20260810 03:49:53.514767 15057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:53.515604 15057 log.cc:824] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:53.517597 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:53.518177 15057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68: No bootstrap required, opened a new log
I20260810 03:49:53.523159 15057 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daabd65bd4743008f61baa33aa87c68" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35419 } }
I20260810 03:49:53.523501 15057 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:53.523581 15057 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6daabd65bd4743008f61baa33aa87c68, State: Initialized, Role: FOLLOWER
I20260810 03:49:53.524155 15057 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daabd65bd4743008f61baa33aa87c68" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35419 } }
I20260810 03:49:53.524353 15057 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:53.524447 15057 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:53.524590 15057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:53.525158 15061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:53.519984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35553 (local address 127.22.134.254:35419)
0810 03:49:53.520136 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:53.520142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:53.520327 (+ 185us) server_negotiation.cc:407] Connection header received
0810 03:49:53.520480 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:53.520482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:53.520523 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:53.520599 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:53.521016 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:53.521638 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:53.522969 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:53.523262 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:53.523357 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:53.524446 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:53.524455 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:53.524457 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:53.524471 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:53.524526 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:53.524541 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:53.524632 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:53.524863 (+ 231us) server_negotiation.cc:299] Negotiation successful
0810 03:49:53.524904 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:49:53.526121 15057 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daabd65bd4743008f61baa33aa87c68" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35419 } }
I20260810 03:49:53.526563 15057 leader_election.cc:302] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6daabd65bd4743008f61baa33aa87c68; no voters:
I20260810 03:49:53.527069 15057 leader_election.cc:288] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:53.527340 15070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:53.527654 15070 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [term 1 LEADER]: Becoming Leader. State: Replica: 6daabd65bd4743008f61baa33aa87c68, State: Running, Role: LEADER
I20260810 03:49:53.528044 15070 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daabd65bd4743008f61baa33aa87c68" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35419 } }
I20260810 03:49:53.528754 15057 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:53.529960 15071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6daabd65bd4743008f61baa33aa87c68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daabd65bd4743008f61baa33aa87c68" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35419 } } }
I20260810 03:49:53.530090 15071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:53.530498 15072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6daabd65bd4743008f61baa33aa87c68. Latest consensus state: current_term: 1 leader_uuid: "6daabd65bd4743008f61baa33aa87c68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6daabd65bd4743008f61baa33aa87c68" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35419 } } }
I20260810 03:49:53.530682 15072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:53.530965 15081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:53.534296 15081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:53.540679 15081 catalog_manager.cc:1347] Generated new cluster ID: 913b982b49fb41bc92e1b517dd794bdc
I20260810 03:49:53.540865 15081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:53.558403 15081 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:53.559952 15081 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:53.570652 15081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6daabd65bd4743008f61baa33aa87c68: Generated new TSK 0
I20260810 03:49:53.571632 15081 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:53.582644 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 14978
W20260810 03:49:53.591898 14962 connection.cc:535] client connection to 127.22.134.254:35419 recv error: Network error: failed to read from TLS socket (remote: 127.22.134.254:35419): Connection reset by peer (error 104)
2026-08-10T03:49:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1569 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:53 dist-test-slave-qg60 krb5kdc[15095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:53 dist-test-slave-qg60 krb5kdc[15095](info): set up 2 sockets
Aug 10 03:49:53 dist-test-slave-qg60 krb5kdc[15095](info): commencing operation
krb5kdc: starting...
W20260810 03:49:54.767102 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:54 dist-test-slave-qg60 krb5kdc[15095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:54.904687 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:41853
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:41853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:55.020790 15110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:55.021209 15110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:55.021262 15110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:55.025458 15110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:55.025533 15110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:55.025554 15110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:55.025571 15110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:55.025588 15110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:55.031186 15110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:41853
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:41853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:55.032373 15110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:55.033488 15110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:55.042598 15119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:55.042892 15110 server_base.cc:1034] running on GCE node
W20260810 03:49:55.042822 15116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:55.042598 15117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:55.043669 15110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:55.044978 15110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:55.046152 15110 hybrid_clock.cc:648] HybridClock initialized: now 1786333795046131 us; error 36 us; skew 500 ppm
Aug 10 03:49:55 dist-test-slave-qg60 krb5kdc[15095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333795, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:55.049301 15110 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:55.050400 15110 webserver.cc:460] Webserver started at http://127.22.134.254:45699/ using document root <none> and password file <none>
I20260810 03:49:55.051002 15110 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:55.051066 15110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:55.051294 15110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:55.053515 15110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "2ac94c46118e4b49a377fd9cfdac4e5a"
format_stamp: "Formatted at 2026-08-10 03:49:55 on dist-test-slave-qg60"
server_key: "c2403a82984cd3acf072f322b140176a"
server_key_iv: "8da0a8eadd1e56109539c5064c1379f2"
server_key_version: "encryptionkey@0"
I20260810 03:49:55.054106 15110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "2ac94c46118e4b49a377fd9cfdac4e5a"
format_stamp: "Formatted at 2026-08-10 03:49:55 on dist-test-slave-qg60"
server_key: "c2403a82984cd3acf072f322b140176a"
server_key_iv: "8da0a8eadd1e56109539c5064c1379f2"
server_key_version: "encryptionkey@0"
I20260810 03:49:55.058015 15110 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:55.060477 15126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:55.061877 15110 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:49:55.062141 15110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "2ac94c46118e4b49a377fd9cfdac4e5a"
format_stamp: "Formatted at 2026-08-10 03:49:55 on dist-test-slave-qg60"
server_key: "c2403a82984cd3acf072f322b140176a"
server_key_iv: "8da0a8eadd1e56109539c5064c1379f2"
server_key_version: "encryptionkey@0"
I20260810 03:49:55.062271 15110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:55.067123 15110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:55.070645 15110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:55.070866 15110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:55.078783 15110 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:41853
I20260810 03:49:55.078869 15188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:41853 every 8 connection(s)
I20260810 03:49:55.079857 15110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:55.082234 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 15110
I20260810 03:49:55.082387 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:55.082677 23067 external_mini_cluster.cc:1428] Setting key e86a10a8b266f986da58d9089b6a3d40
I20260810 03:49:55.083047 15189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:55.088454 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:55.084169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44735 (local address 127.22.134.254:41853)
0810 03:49:55.084622 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:55.084643 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:55.084688 (+ 45us) server_negotiation.cc:407] Connection header received
0810 03:49:55.085479 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:55.085503 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:55.085868 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:55.086269 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:55.087014 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:55.087020 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:55.087037 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:55.087049 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:55.087116 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:55.087148 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:55.087308 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:55.087377 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 03:49:55.087524 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":125,"threads_started":1}
I20260810 03:49:55.090301 15189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a: Bootstrap starting.
I20260810 03:49:55.091358 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:55.092831 15189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:55.093647 15189 log.cc:824] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:55.095381 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:55.093527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36783 (local address 127.22.134.254:41853)
0810 03:49:55.093673 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:55.093678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:55.093855 (+ 177us) server_negotiation.cc:407] Connection header received
0810 03:49:55.093998 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:55.094001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:55.094031 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:55.094128 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:55.094911 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:55.094914 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:55.094917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:55.094929 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:55.094955 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:55.094967 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:55.095059 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:55.095225 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 03:49:55.095264 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:49:55.095996 15189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a: No bootstrap required, opened a new log
I20260810 03:49:55.099743 15189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ac94c46118e4b49a377fd9cfdac4e5a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41853 } }
I20260810 03:49:55.099982 15189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:55.100028 15189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac94c46118e4b49a377fd9cfdac4e5a, State: Initialized, Role: FOLLOWER
I20260810 03:49:55.100425 15189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ac94c46118e4b49a377fd9cfdac4e5a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41853 } }
I20260810 03:49:55.100543 15189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:55.100584 15189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:55.100658 15189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:55.101640 15189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ac94c46118e4b49a377fd9cfdac4e5a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41853 } }
I20260810 03:49:55.101935 15189 leader_election.cc:302] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ac94c46118e4b49a377fd9cfdac4e5a; no voters:
I20260810 03:49:55.102216 15189 leader_election.cc:288] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:55.102361 15199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:55.102613 15199 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [term 1 LEADER]: Becoming Leader. State: Replica: 2ac94c46118e4b49a377fd9cfdac4e5a, State: Running, Role: LEADER
I20260810 03:49:55.102949 15199 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ac94c46118e4b49a377fd9cfdac4e5a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41853 } }
I20260810 03:49:55.103502 15189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:55.104871 15200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ac94c46118e4b49a377fd9cfdac4e5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ac94c46118e4b49a377fd9cfdac4e5a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41853 } } }
I20260810 03:49:55.105003 15200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:55.105365 15201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ac94c46118e4b49a377fd9cfdac4e5a. Latest consensus state: current_term: 1 leader_uuid: "2ac94c46118e4b49a377fd9cfdac4e5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ac94c46118e4b49a377fd9cfdac4e5a" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 41853 } } }
I20260810 03:49:55.105520 15201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:55.105433 15208 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:55.108589 15208 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:55.114494 15208 catalog_manager.cc:1347] Generated new cluster ID: 677851e7ba72444d9f5515233c6130e1
I20260810 03:49:55.114578 15208 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:55.131218 15208 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:55.131613 15208 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:55.138669 15208 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ac94c46118e4b49a377fd9cfdac4e5a: Generated new TSK 0
I20260810 03:49:55.139434 15208 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:55.142786 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 15110
2026-08-10T03:49:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1559 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:55 dist-test-slave-qg60 krb5kdc[15220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:55 dist-test-slave-qg60 krb5kdc[15220](info): set up 2 sockets
Aug 10 03:49:55 dist-test-slave-qg60 krb5kdc[15220](info): commencing operation
krb5kdc: starting...
W20260810 03:49:56.322916 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:56 dist-test-slave-qg60 krb5kdc[15220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:56.461437 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35493
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:42817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:35493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:56.580085 15236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:56.580374 15236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:56.580417 15236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:56.584506 15236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:56.584581 15236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:56.584601 15236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:56.584618 15236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:56.584633 15236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:56.590301 15236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:42817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:35493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:35493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:56.591361 15236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:56.592378 15236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:56.601709 15241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:56.601958 15236 server_base.cc:1034] running on GCE node
W20260810 03:49:56.601709 15245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:56.601706 15243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:56.602664 15236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:56.603746 15236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:56.604945 15236 hybrid_clock.cc:648] HybridClock initialized: now 1786333796604906 us; error 51 us; skew 500 ppm
Aug 10 03:49:56 dist-test-slave-qg60 krb5kdc[15220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333796, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:56.607923 15236 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:56.609032 15236 webserver.cc:460] Webserver started at http://127.22.134.254:38645/ using document root <none> and password file <none>
I20260810 03:49:56.609671 15236 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:56.609777 15236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:56.610031 15236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:56.612257 15236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "c3e6b31f19b743d6b63fc751de2be50b"
format_stamp: "Formatted at 2026-08-10 03:49:56 on dist-test-slave-qg60"
server_key: "552ee1b69a5c3eeab97bc30318400450"
server_key_iv: "fc09c2aef01c5ce012b7465f45e16ea3"
server_key_version: "encryptionkey@0"
I20260810 03:49:56.612944 15236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "c3e6b31f19b743d6b63fc751de2be50b"
format_stamp: "Formatted at 2026-08-10 03:49:56 on dist-test-slave-qg60"
server_key: "552ee1b69a5c3eeab97bc30318400450"
server_key_iv: "fc09c2aef01c5ce012b7465f45e16ea3"
server_key_version: "encryptionkey@0"
I20260810 03:49:56.616997 15236 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:49:56.619493 15254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:56.620882 15236 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 03:49:56.621037 15236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "c3e6b31f19b743d6b63fc751de2be50b"
format_stamp: "Formatted at 2026-08-10 03:49:56 on dist-test-slave-qg60"
server_key: "552ee1b69a5c3eeab97bc30318400450"
server_key_iv: "fc09c2aef01c5ce012b7465f45e16ea3"
server_key_version: "encryptionkey@0"
I20260810 03:49:56.621166 15236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:56.647651 15236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:56.651278 15236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:56.651520 15236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:56.659194 15236 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:35493
I20260810 03:49:56.659251 15314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:35493 every 8 connection(s)
I20260810 03:49:56.660259 15236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:56.663237 15315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:56.669015 15315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b: Bootstrap starting.
I20260810 03:49:56.669587 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 15236
I20260810 03:49:56.669780 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:56.670079 23067 external_mini_cluster.cc:1428] Setting key 7f04cb9cb07614c09351e929326a2e7a
I20260810 03:49:56.671828 15315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:56.672688 15315 log.cc:824] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:56.675022 15315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b: No bootstrap required, opened a new log
I20260810 03:49:56.679582 15315 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e6b31f19b743d6b63fc751de2be50b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35493 } }
I20260810 03:49:56.679944 15315 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:56.680014 15315 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e6b31f19b743d6b63fc751de2be50b, State: Initialized, Role: FOLLOWER
Aug 10 03:49:56 dist-test-slave-qg60 krb5kdc[15220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:49:56.680578 15315 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e6b31f19b743d6b63fc751de2be50b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35493 } }
I20260810 03:49:56.680785 15315 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:56.680866 15315 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:56.680991 15315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:56.682024 15315 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e6b31f19b743d6b63fc751de2be50b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35493 } }
I20260810 03:49:56.682391 15315 leader_election.cc:302] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3e6b31f19b743d6b63fc751de2be50b; no voters:
I20260810 03:49:56.682776 15315 leader_election.cc:288] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:56.682860 15320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:56.683100 15320 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [term 1 LEADER]: Becoming Leader. State: Replica: c3e6b31f19b743d6b63fc751de2be50b, State: Running, Role: LEADER
I20260810 03:49:56.683485 15320 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e6b31f19b743d6b63fc751de2be50b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35493 } }
I20260810 03:49:56.684217 15315 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:56.685365 15321 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3e6b31f19b743d6b63fc751de2be50b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e6b31f19b743d6b63fc751de2be50b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35493 } } }
I20260810 03:49:56.685498 15321 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:56.685871 15322 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3e6b31f19b743d6b63fc751de2be50b. Latest consensus state: current_term: 1 leader_uuid: "c3e6b31f19b743d6b63fc751de2be50b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e6b31f19b743d6b63fc751de2be50b" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 35493 } } }
I20260810 03:49:56.686064 15322 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:56.686715 15331 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:56.687616 15318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:56.671446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51871 (local address 127.22.134.254:35493)
0810 03:49:56.672030 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:56.672050 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:56.672094 (+ 44us) server_negotiation.cc:407] Connection header received
0810 03:49:56.673096 (+ 1002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:56.673123 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:56.673501 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:56.673818 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:56.674767 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:56.676040 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:56.677301 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:56.677905 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:56.678098 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:56.681380 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:56.681385 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:56.681400 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:56.681434 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:56.683674 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:56.684223 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:56.684229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:56.684235 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:56.684428 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:56.684805 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:56.684809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:56.684810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:56.685361 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:56.685553 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:56.686494 (+ 941us) server_negotiation.cc:299] Negotiation successful
0810 03:49:56.686840 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":176,"threads_started":1}
I20260810 03:49:56.690035 15331 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:56.691052 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:56.696460 15331 catalog_manager.cc:1347] Generated new cluster ID: e309615a1b08484faa1402bda571b355
I20260810 03:49:56.696533 15331 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:56.702085 15318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:56.693118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37023 (local address 127.22.134.254:35493)
0810 03:49:56.693226 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:56.693230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:56.693510 (+ 280us) server_negotiation.cc:407] Connection header received
0810 03:49:56.693638 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:56.693641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:56.693690 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:56.693773 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:56.694660 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:56.695489 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:56.696469 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:56.696825 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:56.696935 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:56.698645 (+ 1710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:56.698648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:56.698651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:49:56.698676 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:56.700314 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:56.700856 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:56.700859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:56.700861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:56.700943 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:49:56.701243 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:49:56.701245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:49:56.701247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:49:56.701441 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:56.701570 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:56.701824 (+ 254us) server_negotiation.cc:299] Negotiation successful
0810 03:49:56.701933 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 03:49:56.711596 15331 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:56.712615 15331 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:56.726464 15331 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3e6b31f19b743d6b63fc751de2be50b: Generated new TSK 0
I20260810 03:49:56.727317 15331 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:56.732748 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 15236
2026-08-10T03:49:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1589 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:56 dist-test-slave-qg60 krb5kdc[15351](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:56 dist-test-slave-qg60 krb5kdc[15351](info): set up 2 sockets
Aug 10 03:49:56 dist-test-slave-qg60 krb5kdc[15351](info): commencing operation
krb5kdc: starting...
W20260810 03:49:57.855751 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:57 dist-test-slave-qg60 krb5kdc[15351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:57.996479 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:39261
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:39261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:58.116014 15364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:58.116408 15364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:58.116501 15364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:58.120823 15364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:58.120945 15364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:58.120982 15364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:58.121023 15364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:58.121057 15364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:58.128046 15364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:39261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:39261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:58.129388 15364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:58.130481 15364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:58.139534 15371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:58.139546 15373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:58.139537 15370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:58.139786 15364 server_base.cc:1034] running on GCE node
I20260810 03:49:58.140573 15364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:58.142169 15364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:58.143402 15364 hybrid_clock.cc:648] HybridClock initialized: now 1786333798143380 us; error 40 us; skew 500 ppm
Aug 10 03:49:58 dist-test-slave-qg60 krb5kdc[15351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333798, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:58.146845 15364 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:58.147966 15364 webserver.cc:460] Webserver started at http://127.22.134.254:43319/ using document root <none> and password file <none>
I20260810 03:49:58.148602 15364 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:58.148707 15364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:58.149009 15364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:58.151393 15364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "9a9c9a167da34d099351dd6ed8394ddc"
format_stamp: "Formatted at 2026-08-10 03:49:58 on dist-test-slave-qg60"
server_key: "16160e77f713fda858af434cac514d75"
server_key_iv: "3a35308e630617eb1d1b6a4b38bc8cf8"
server_key_version: "encryptionkey@0"
I20260810 03:49:58.152127 15364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "9a9c9a167da34d099351dd6ed8394ddc"
format_stamp: "Formatted at 2026-08-10 03:49:58 on dist-test-slave-qg60"
server_key: "16160e77f713fda858af434cac514d75"
server_key_iv: "3a35308e630617eb1d1b6a4b38bc8cf8"
server_key_version: "encryptionkey@0"
I20260810 03:49:58.156575 15364 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260810 03:49:58.159440 15380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:58.161087 15364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:49:58.161273 15364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "9a9c9a167da34d099351dd6ed8394ddc"
format_stamp: "Formatted at 2026-08-10 03:49:58 on dist-test-slave-qg60"
server_key: "16160e77f713fda858af434cac514d75"
server_key_iv: "3a35308e630617eb1d1b6a4b38bc8cf8"
server_key_version: "encryptionkey@0"
I20260810 03:49:58.161415 15364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:58.206712 15364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:58.210459 15364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:58.210706 15364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:58.218596 15364 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:39261
I20260810 03:49:58.218612 15437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:39261 every 8 connection(s)
I20260810 03:49:58.219669 15364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:58.222623 15438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:58.225272 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 15364
I20260810 03:49:58.225386 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:58.225706 23067 external_mini_cluster.cc:1428] Setting key 3c3c245ddd39d78272856966867b675f
I20260810 03:49:58.228600 15438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc: Bootstrap starting.
I20260810 03:49:58.231226 15438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:58.232131 15438 log.cc:824] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:58.234627 15438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc: No bootstrap required, opened a new log
I20260810 03:49:58.235916 15441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:58.227226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59007 (local address 127.22.134.254:39261)
0810 03:49:58.227679 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:58.227696 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:58.227733 (+ 37us) server_negotiation.cc:407] Connection header received
0810 03:49:58.228429 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:58.228447 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:58.228894 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:58.229213 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:58.229560 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:58.230640 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:58.231932 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:58.232587 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:58.232822 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:58.233771 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:58.233778 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:58.233794 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:58.234330 (+ 536us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:58.234404 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:58.234437 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:58.234546 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:58.234695 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 03:49:58.234919 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":154,"threads_started":1}
I20260810 03:49:58.238945 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:58.239432 15438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9c9a167da34d099351dd6ed8394ddc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39261 } }
I20260810 03:49:58.239672 15438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:58.239749 15438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9c9a167da34d099351dd6ed8394ddc, State: Initialized, Role: FOLLOWER
I20260810 03:49:58.240293 15438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9c9a167da34d099351dd6ed8394ddc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39261 } }
I20260810 03:49:58.240484 15438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:58.240559 15438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:58.240664 15438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:58.242093 15438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9c9a167da34d099351dd6ed8394ddc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39261 } }
I20260810 03:49:58.242482 15438 leader_election.cc:302] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a9c9a167da34d099351dd6ed8394ddc; no voters:
I20260810 03:49:58.242836 15438 leader_election.cc:288] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:58.242945 15449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:58.243232 15449 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [term 1 LEADER]: Becoming Leader. State: Replica: 9a9c9a167da34d099351dd6ed8394ddc, State: Running, Role: LEADER
I20260810 03:49:58.243594 15449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9c9a167da34d099351dd6ed8394ddc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39261 } }
I20260810 03:49:58.244287 15438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:58.244890 15449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a9c9a167da34d099351dd6ed8394ddc. Latest consensus state: current_term: 1 leader_uuid: "9a9c9a167da34d099351dd6ed8394ddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9c9a167da34d099351dd6ed8394ddc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39261 } } }
I20260810 03:49:58.245445 15449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:58.245657 15452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a9c9a167da34d099351dd6ed8394ddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9c9a167da34d099351dd6ed8394ddc" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 39261 } } }
I20260810 03:49:58.245925 15452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:58.246236 15441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:58.241254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56029 (local address 127.22.134.254:39261)
0810 03:49:58.241376 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:58.241380 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:58.241533 (+ 153us) server_negotiation.cc:407] Connection header received
0810 03:49:58.241693 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:58.241695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:58.241735 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:58.241804 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:58.242225 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:58.242902 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:58.244103 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:49:58.244442 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:49:58.244569 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:49:58.245637 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:58.245641 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:58.245644 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:58.245661 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:58.245692 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:58.245707 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:58.245765 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:58.245977 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 03:49:58.246043 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:49:58.246073 15454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:58.250022 15454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:58.255468 15454 catalog_manager.cc:1347] Generated new cluster ID: 324dd9ce09a4447fbb47b54926d0314f
I20260810 03:49:58.255554 15454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:58.271296 15454 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:58.272576 15454 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:58.279614 15454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a9c9a167da34d099351dd6ed8394ddc: Generated new TSK 0
I20260810 03:49:58.280402 15454 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:58.290266 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 15364
2026-08-10T03:49:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1557 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:58 dist-test-slave-qg60 krb5kdc[15472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:58 dist-test-slave-qg60 krb5kdc[15472](info): set up 2 sockets
Aug 10 03:49:58 dist-test-slave-qg60 krb5kdc[15472](info): commencing operation
krb5kdc: starting...
W20260810 03:49:59.420158 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:49:59 dist-test-slave-qg60 krb5kdc[15472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:49:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:49:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:49:59.558128 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40295
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:38849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:40295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:49:59.674966 15487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:49:59.675273 15487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:49:59.675318 15487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:49:59.679445 15487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:49:59.679524 15487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:49:59.679544 15487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:49:59.679562 15487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:49:59.679579 15487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:49:59.685349 15487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:38849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:40295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:40295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:49:59.686437 15487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:49:59.687420 15487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:49:59.696430 15493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:49:59.696456 15492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:59.696504 15487 server_base.cc:1034] running on GCE node
W20260810 03:49:59.696770 15496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:49:59.697319 15487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:49:59.698518 15487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:49:59.699729 15487 hybrid_clock.cc:648] HybridClock initialized: now 1786333799699697 us; error 48 us; skew 500 ppm
Aug 10 03:49:59 dist-test-slave-qg60 krb5kdc[15472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333799, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:49:59.702768 15487 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:49:59.703768 15487 webserver.cc:460] Webserver started at http://127.22.134.254:42783/ using document root <none> and password file <none>
I20260810 03:49:59.704355 15487 fs_manager.cc:359] Metadata directory not provided
I20260810 03:49:59.704447 15487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:49:59.704697 15487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:49:59.706864 15487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "24f3111896124900b83418a2f8891091"
format_stamp: "Formatted at 2026-08-10 03:49:59 on dist-test-slave-qg60"
server_key: "dfc0ce8a136e35ee91e64bf6ebbfb0a4"
server_key_iv: "a29867c2d5b125a0eb31809fc452dcb3"
server_key_version: "encryptionkey@0"
I20260810 03:49:59.707461 15487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "24f3111896124900b83418a2f8891091"
format_stamp: "Formatted at 2026-08-10 03:49:59 on dist-test-slave-qg60"
server_key: "dfc0ce8a136e35ee91e64bf6ebbfb0a4"
server_key_iv: "a29867c2d5b125a0eb31809fc452dcb3"
server_key_version: "encryptionkey@0"
I20260810 03:49:59.711575 15487 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 03:49:59.714416 15503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:49:59.716028 15487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:49:59.716192 15487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "24f3111896124900b83418a2f8891091"
format_stamp: "Formatted at 2026-08-10 03:49:59 on dist-test-slave-qg60"
server_key: "dfc0ce8a136e35ee91e64bf6ebbfb0a4"
server_key_iv: "a29867c2d5b125a0eb31809fc452dcb3"
server_key_version: "encryptionkey@0"
I20260810 03:49:59.716323 15487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:49:59.721345 15487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:49:59.724843 15487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:49:59.725055 15487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:49:59.732815 15487 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:40295
I20260810 03:49:59.732844 15562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:40295 every 8 connection(s)
I20260810 03:49:59.733814 15487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:49:59.735810 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 15487
I20260810 03:49:59.735947 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:49:59.736263 23067 external_mini_cluster.cc:1428] Setting key f5eae4a039441fc4bbcc61dcc1959a8e
I20260810 03:49:59.737272 15564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:49:59.741938 15567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:59.737762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51833 (local address 127.22.134.254:40295)
0810 03:49:59.738193 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:59.738212 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:59.738248 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:49:59.738883 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:59.738899 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:59.739278 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:59.739575 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:59.740503 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:59.740508 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:59.740520 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:59.740532 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:59.740594 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:59.740615 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:59.740838 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:59.740902 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 03:49:59.741096 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":140,"threads_started":1}
I20260810 03:49:59.744273 15564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091: Bootstrap starting.
I20260810 03:49:59.745235 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:49:59.746829 15564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091: Neither blocks nor log segments found. Creating new log.
I20260810 03:49:59.747712 15564 log.cc:824] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091: Log is configured to *not* fsync() on all Append() calls
I20260810 03:49:59.749377 15567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:49:59.747491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56313 (local address 127.22.134.254:40295)
0810 03:49:59.747640 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 03:49:59.747645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:49:59.747845 (+ 200us) server_negotiation.cc:407] Connection header received
0810 03:49:59.748008 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:49:59.748011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:49:59.748048 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:49:59.748134 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:49:59.748978 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:49:59.748982 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:49:59.748984 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 03:49:59.748996 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:49:59.749027 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 03:49:59.749040 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:49:59.749134 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 03:49:59.749204 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 03:49:59.749242 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 03:49:59.750110 15564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091: No bootstrap required, opened a new log
I20260810 03:49:59.754377 15564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f3111896124900b83418a2f8891091" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40295 } }
I20260810 03:49:59.754642 15564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 03:49:59.754762 15564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24f3111896124900b83418a2f8891091, State: Initialized, Role: FOLLOWER
I20260810 03:49:59.755322 15564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f3111896124900b83418a2f8891091" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40295 } }
I20260810 03:49:59.755527 15564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 03:49:59.755613 15564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 03:49:59.755721 15564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:49:59.756839 15564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f3111896124900b83418a2f8891091" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40295 } }
I20260810 03:49:59.757206 15564 leader_election.cc:302] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24f3111896124900b83418a2f8891091; no voters:
I20260810 03:49:59.757635 15564 leader_election.cc:288] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 03:49:59.757880 15574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:49:59.758128 15574 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [term 1 LEADER]: Becoming Leader. State: Replica: 24f3111896124900b83418a2f8891091, State: Running, Role: LEADER
I20260810 03:49:59.758452 15574 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f3111896124900b83418a2f8891091" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40295 } }
I20260810 03:49:59.759032 15564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:49:59.760196 15576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24f3111896124900b83418a2f8891091. Latest consensus state: current_term: 1 leader_uuid: "24f3111896124900b83418a2f8891091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f3111896124900b83418a2f8891091" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40295 } } }
I20260810 03:49:59.760349 15576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:59.760748 15584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:49:59.760876 15575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24f3111896124900b83418a2f8891091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f3111896124900b83418a2f8891091" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 40295 } } }
I20260810 03:49:59.761075 15575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091 [sys.catalog]: This master's current role is: LEADER
I20260810 03:49:59.764175 15584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:49:59.770275 15584 catalog_manager.cc:1347] Generated new cluster ID: 2120ab1ec7c4471389fd9d2be40d1aff
I20260810 03:49:59.770365 15584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:49:59.792568 15584 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:49:59.793007 15584 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:49:59.804942 15584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24f3111896124900b83418a2f8891091: Generated new TSK 0
I20260810 03:49:59.805881 15584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 03:49:59.819491 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 15487
2026-08-10T03:49:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1529 ms)
[----------] 18 tests from AuthTokenIssuingTest (28077 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:49:59 dist-test-slave-qg60 krb5kdc[15597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:49:59 dist-test-slave-qg60 krb5kdc[15597](info): set up 2 sockets
Aug 10 03:49:59 dist-test-slave-qg60 krb5kdc[15597](info): commencing operation
krb5kdc: starting...
W20260810 03:50:00.951534 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:50:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:50:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:50:01.093063 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38337
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38337,127.22.134.253:45937,127.22.134.252:33015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:50:01.209721 15610 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:50:01.210126 15610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:50:01.210196 15610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:50:01.210274 15610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:50:01.214496 15610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:50:01.214610 15610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:50:01.214650 15610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:50:01.214691 15610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:50:01.214727 15610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:50:01.220299 15610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38337,127.22.134.253:45937,127.22.134.252:33015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:50:01.221522 15610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:50:01.222601 15610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:50:01.232228 15610 server_base.cc:1034] running on GCE node
W20260810 03:50:01.232191 15617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:01.232273 15619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:01.232255 15616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:50:01.233186 15610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:50:01.234476 15610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:50:01.235667 15610 hybrid_clock.cc:648] HybridClock initialized: now 1786333801235646 us; error 34 us; skew 500 ppm
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:50:01.244196 15610 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:50:01.245352 15610 webserver.cc:460] Webserver started at http://127.22.134.254:37497/ using document root <none> and password file <none>
I20260810 03:50:01.245947 15610 fs_manager.cc:359] Metadata directory not provided
I20260810 03:50:01.246014 15610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:50:01.246229 15610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:50:01.248507 15610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "84907f04fd4a4442807b8f4fb594c318"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "36fbc85adf935a3a8efc4786464b8480"
server_key_iv: "df5f1b689d2727198457326aa20f39a2"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.249199 15610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "84907f04fd4a4442807b8f4fb594c318"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "36fbc85adf935a3a8efc4786464b8480"
server_key_iv: "df5f1b689d2727198457326aa20f39a2"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.253293 15610 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:50:01.255908 15628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:50:01.257373 15610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:50:01.257525 15610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "84907f04fd4a4442807b8f4fb594c318"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "36fbc85adf935a3a8efc4786464b8480"
server_key_iv: "df5f1b689d2727198457326aa20f39a2"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.257656 15610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:50:01.278465 15610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:50:01.281984 15610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:50:01.282218 15610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:50:01.289937 15610 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:38337
I20260810 03:50:01.290304 15687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:38337 every 8 connection(s)
I20260810 03:50:01.290990 15610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:50:01.291308 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 15610
I20260810 03:50:01.291453 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:50:01.291826 23067 external_mini_cluster.cc:1428] Setting key 1cd1e270f5b97010a4d66dac6c61aeaa
I20260810 03:50:01.294140 15688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:50:01.298132 15688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.134.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.253@KRBTEST.COM" created.
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:50:01.317198 15693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.301533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33502 (local address 127.22.134.254:38337)
0810 03:50:01.301802 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.301812 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.301848 (+ 36us) server_negotiation.cc:407] Connection header received
0810 03:50:01.302567 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.302572 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.302794 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.302954 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.303933 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.305377 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.307041 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.307787 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.308000 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.311124 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.311134 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.311150 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.311182 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.313575 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.314172 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.314183 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.314187 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.314355 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.314751 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.314754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.314756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.315246 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.315374 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.315904 (+ 530us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.316354 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":165,"thread_start_us":94,"threads_started":1}
I20260810 03:50:01.317198 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.300637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38337 (local address 127.0.0.1:33502)
0810 03:50:01.301226 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.301272 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.302253 (+ 981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.302989 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.302994 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.303508 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.303769 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.303782 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.305556 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.305563 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.306897 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.306907 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.307985 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.307989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.308127 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.308866 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.308886 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.310935 (+ 2049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.313718 (+ 2783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.313727 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.313735 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.313972 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.314481 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.314483 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.314485 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.314623 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.315390 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.315397 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.315620 (+ 223us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.315807 (+ 187us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.316116 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":128,"threads_started":1}
I20260810 03:50:01.320129 15688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:01.321133 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.320825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34802)
0810 03:50:01.320957 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.321052 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 03:50:01.321475 15631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
I20260810 03:50:01.322628 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.322379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34816)
0810 03:50:01.322502 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.322565 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 03:50:01.322842 15688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:45937: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab.
Entry for principal kudu/127.22.134.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab.
I20260810 03:50:01.323902 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.253:45937
--webserver_interface=127.22.134.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab
--principal=kudu/127.22.134.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38337,127.22.134.253:45937,127.22.134.252:33015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:50:01.372164 15688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } attempt: 1
I20260810 03:50:01.373234 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.372880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34828)
0810 03:50:01.373071 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.373146 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260810 03:50:01.374104 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.373832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34834)
0810 03:50:01.373973 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.374031 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260810 03:50:01.374307 15688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:45937: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
I20260810 03:50:01.442528 15688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } attempt: 2
I20260810 03:50:01.443650 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.443298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34838)
0810 03:50:01.443481 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.443561 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260810 03:50:01.444464 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.444230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34844)
0810 03:50:01.444339 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.444389 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 03:50:01.444640 15688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:45937: Network error: Client connection negotiation failed: client connection to 127.22.134.253:45937: connect: Connection refused (error 111)
W20260810 03:50:01.446830 15696 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:50:01.447142 15696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:50:01.447211 15696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:50:01.447299 15696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:50:01.452139 15696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:50:01.452204 15696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:50:01.452226 15696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:50:01.452246 15696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:50:01.452291 15696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:50:01.458518 15696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38337,127.22.134.253:45937,127.22.134.252:33015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab
--principal=kudu/127.22.134.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.253:45937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.134.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:50:01.459735 15696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:50:01.461050 15696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 03:50:01.471086 15696 server_base.cc:1034] running on GCE node
W20260810 03:50:01.471136 15705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:01.471176 15702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:01.471287 15703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:50:01.471985 15696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:50:01.473559 15696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:50:01.474768 15696 hybrid_clock.cc:648] HybridClock initialized: now 1786333801474752 us; error 31 us; skew 500 ppm
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:50:01.478456 15696 init.cc:377] Logged in from keytab as kudu/127.22.134.253@KRBTEST.COM (short username kudu)
I20260810 03:50:01.479559 15696 webserver.cc:460] Webserver started at http://127.22.134.253:38781/ using document root <none> and password file <none>
I20260810 03:50:01.480221 15696 fs_manager.cc:359] Metadata directory not provided
I20260810 03:50:01.480294 15696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:50:01.480548 15696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:50:01.482872 15696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/data/instance:
uuid: "8a72fa471c5b440d96068070b199ff70"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "750a35a71332c5b4b299e073e874b2d9"
server_key_iv: "d3685ccee98599a1da8df64032687025"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.483546 15696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/wal/instance:
uuid: "8a72fa471c5b440d96068070b199ff70"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "750a35a71332c5b4b299e073e874b2d9"
server_key_iv: "d3685ccee98599a1da8df64032687025"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.487759 15696 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 03:50:01.490521 15712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:50:01.491842 15696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 03:50:01.492003 15696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/wal
uuid: "8a72fa471c5b440d96068070b199ff70"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "750a35a71332c5b4b299e073e874b2d9"
server_key_iv: "d3685ccee98599a1da8df64032687025"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.492133 15696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:50:01.504474 15696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:50:01.508030 15696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:50:01.508257 15696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:50:01.516006 15696 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.253:45937
I20260810 03:50:01.516279 15772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.253:45937 every 8 connection(s)
I20260810 03:50:01.517143 15696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
I20260810 03:50:01.520035 15773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:50:01.522188 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 15696
I20260810 03:50:01.522333 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-1/wal/instance
I20260810 03:50:01.522634 23067 external_mini_cluster.cc:1428] Setting key 5f201f8d3918ef9e98b3ca59c25e98f3
I20260810 03:50:01.524242 15773 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.134.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.252@KRBTEST.COM" created.
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:50:01.535831 15688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } attempt: 3
I20260810 03:50:01.542033 15693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.526653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33510 (local address 127.22.134.254:38337)
0810 03:50:01.526854 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.526861 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.527736 (+ 875us) server_negotiation.cc:407] Connection header received
0810 03:50:01.528899 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.528905 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.528991 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.529111 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.530375 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.531263 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.532813 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.533145 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.533294 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.536236 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.536243 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.536250 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.536289 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.538358 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.538984 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.538991 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.538996 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.539102 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.539508 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.539514 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.539519 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.539800 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.539924 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.541640 (+ 1716us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.541799 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 03:50:01.542052 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.526978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38337 (local address 127.0.0.1:33510)
0810 03:50:01.527545 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.527605 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.528605 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.529287 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.529294 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.529671 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.530207 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.530222 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.531418 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.531421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.532640 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.532652 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.533354 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.533365 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.533539 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.534230 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.534249 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.535935 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.538471 (+ 2536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.538477 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.538499 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.538873 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.539215 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.539218 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.539220 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.539388 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.539921 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.539928 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.540265 (+ 337us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.540465 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.540839 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":166,"threads_started":1}
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
I20260810 03:50:01.544292 15773 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:01.548274 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.536347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34850)
0810 03:50:01.536523 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.536535 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.536630 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.537987 (+ 1357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.537993 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.538371 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.538540 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.538550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.539790 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.539795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.540581 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.540592 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.541344 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.541347 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.541447 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.541945 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.541960 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.543370 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.546296 (+ 2926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.546299 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.546300 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.546510 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.546883 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.546885 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.546887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.546971 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.547595 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.547599 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.547749 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.547863 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.548085 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260810 03:50:01.548313 15779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.536720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34850 (local address 127.22.134.253:45937)
0810 03:50:01.537165 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.537178 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.537204 (+ 26us) server_negotiation.cc:407] Connection header received
0810 03:50:01.537253 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.537262 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.537800 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.537958 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.538682 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.539676 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.540709 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.541203 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.542581 (+ 1378us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.543562 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.543572 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.543589 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.543619 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.546154 (+ 2535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.546678 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.546685 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.546687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.546786 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.547061 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.547064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.547066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.547472 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.547618 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.547968 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.548130 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":166,"threads_started":1}
I20260810 03:50:01.551430 15688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
I20260810 03:50:01.552393 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.552070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50198)
0810 03:50:01.552232 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.552297 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 03:50:01.553363 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.552987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50204)
0810 03:50:01.553205 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.553272 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260810 03:50:01.553615 15688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:33015: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab.
Entry for principal kudu/127.22.134.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab.
I20260810 03:50:01.556038 15781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.545073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34864 (local address 127.22.134.253:45937)
0810 03:50:01.546462 (+ 1389us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.546471 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.546485 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:50:01.546518 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.546521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.546585 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.546715 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.547152 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.547755 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.548641 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.549684 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.549793 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.552271 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.552276 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.552278 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.552304 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.554230 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.554716 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.554718 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.554720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.554807 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.555073 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.555076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.555077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.555287 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.555374 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.555719 (+ 345us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.555890 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1301,"thread_start_us":143,"threads_started":1}
I20260810 03:50:01.556044 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.544999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34864)
0810 03:50:01.545112 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.545127 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.545211 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.546733 (+ 1522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.546738 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.546918 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.547059 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.547065 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.547866 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.547872 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.548517 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.548526 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.549817 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.549821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.549909 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.550362 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.550376 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.552086 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.554404 (+ 2318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.554407 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.554409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.554614 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.554893 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.554896 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.554897 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.554989 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.555375 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.555377 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.555480 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.555630 (+ 150us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.555784 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 03:50:01.556964 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.252:33015
--webserver_interface=127.22.134.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab
--principal=kudu/127.22.134.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:33695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38337,127.22.134.253:45937,127.22.134.252:33015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:50:01.557008 15773 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:01.557690 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.557436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50220)
0810 03:50:01.557551 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.557631 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 03:50:01.557902 15714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
I20260810 03:50:01.559450 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.558633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50232)
0810 03:50:01.559306 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.559369 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":581}
W20260810 03:50:01.559675 15773 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:33015: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
I20260810 03:50:01.584806 15688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } attempt: 1
I20260810 03:50:01.585731 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.585406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50238)
0810 03:50:01.585555 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.585629 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 03:50:01.586588 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.586367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50244)
0810 03:50:01.586482 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.586536 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 03:50:01.586745 15688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:33015: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
I20260810 03:50:01.608978 15773 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } attempt: 1
I20260810 03:50:01.609929 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.609598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50260)
0810 03:50:01.609781 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.609854 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260810 03:50:01.610697 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.610470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50266)
0810 03:50:01.610577 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.610632 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:50:01.610827 15773 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:33015: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
I20260810 03:50:01.661919 15688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } attempt: 2
I20260810 03:50:01.662869 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.662530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50270)
0810 03:50:01.662683 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.662751 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 03:50:01.663623 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.663398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50276)
0810 03:50:01.663508 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.663557 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 03:50:01.663762 15688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:33015: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
I20260810 03:50:01.679004 15773 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } attempt: 2
I20260810 03:50:01.679970 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.679598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50290)
0810 03:50:01.679824 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.679888 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260810 03:50:01.680039 15783 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:50:01.680491 15783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:50:01.680543 15783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:50:01.680609 15783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 03:50:01.680886 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.680591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50300)
0810 03:50:01.680775 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.680830 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260810 03:50:01.681012 15773 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:33015: Network error: Client connection negotiation failed: client connection to 127.22.134.252:33015: connect: Connection refused (error 111)
W20260810 03:50:01.684935 15783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:50:01.685009 15783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:50:01.685056 15783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:50:01.685091 15783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:50:01.685128 15783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:50:01.690588 15783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:33695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38337,127.22.134.253:45937,127.22.134.252:33015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab
--principal=kudu/127.22.134.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.252:33015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.134.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:50:01.691753 15783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:50:01.692879 15783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:50:01.702019 15793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:01.702051 15789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:01.702080 15790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:50:01.702392 15783 server_base.cc:1034] running on GCE node
I20260810 03:50:01.702934 15783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:50:01.704084 15783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:50:01.705260 15783 hybrid_clock.cc:648] HybridClock initialized: now 1786333801705247 us; error 26 us; skew 500 ppm
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:50:01.708215 15783 init.cc:377] Logged in from keytab as kudu/127.22.134.252@KRBTEST.COM (short username kudu)
I20260810 03:50:01.709239 15783 webserver.cc:460] Webserver started at http://127.22.134.252:34347/ using document root <none> and password file <none>
I20260810 03:50:01.709816 15783 fs_manager.cc:359] Metadata directory not provided
I20260810 03:50:01.709910 15783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:50:01.710161 15783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:50:01.712257 15783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/data/instance:
uuid: "afb21393578b47e1b748997a1bbb1f09"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "d334d458e6563c1b7c4a9a8b3e3aebf8"
server_key_iv: "f579ae312742b024673583bf254e39a5"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.712927 15783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/wal/instance:
uuid: "afb21393578b47e1b748997a1bbb1f09"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "d334d458e6563c1b7c4a9a8b3e3aebf8"
server_key_iv: "f579ae312742b024673583bf254e39a5"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.716935 15783 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:50:01.719751 15800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:50:01.721262 15783 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:50:01.721419 15783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/wal
uuid: "afb21393578b47e1b748997a1bbb1f09"
format_stamp: "Formatted at 2026-08-10 03:50:01 on dist-test-slave-qg60"
server_key: "d334d458e6563c1b7c4a9a8b3e3aebf8"
server_key_iv: "f579ae312742b024673583bf254e39a5"
server_key_version: "encryptionkey@0"
I20260810 03:50:01.721542 15783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:50:01.732082 15783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:50:01.735589 15783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:50:01.735810 15783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:50:01.743369 15783 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.252:33015
I20260810 03:50:01.744540 15857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.252:33015 every 8 connection(s)
I20260810 03:50:01.744755 15783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
I20260810 03:50:01.746403 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 15783
I20260810 03:50:01.746552 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786333502007595-23067-0/minicluster-data/master-2/wal/instance
I20260810 03:50:01.746927 23067 external_mini_cluster.cc:1428] Setting key f91efe72cc7c16315660b0a11410c1d2
I20260810 03:50:01.749197 15858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:50:01.755366 15858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:01.762904 15688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } attempt: 3
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
I20260810 03:50:01.772159 15773 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } attempt: 3
I20260810 03:50:01.777561 15693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.758383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33512 (local address 127.22.134.254:38337)
0810 03:50:01.759389 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.759394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.759410 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:50:01.759458 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.759461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.759530 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.759629 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.761313 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.761952 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.763555 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.763921 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.764042 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.771094 (+ 7052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.771100 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.771105 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.771137 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.774380 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.775148 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.775155 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.775159 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.775268 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.775706 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.775709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.775711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.776052 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.776164 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.777238 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.777415 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":892}
I20260810 03:50:01.777977 15862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.758344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38337 (local address 127.0.0.1:33512)
0810 03:50:01.758865 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.758924 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.759077 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.759833 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.759842 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.760443 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.761113 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.761133 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.762196 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.762202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.763416 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.763427 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.764217 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.764221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.764589 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.767121 (+ 2532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.767150 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.770925 (+ 3775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.774556 (+ 3631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.774569 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.774579 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.774993 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.775421 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.775428 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.775433 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.775568 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.776231 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.776239 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.776415 (+ 176us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.776600 (+ 185us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.776855 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":454,"thread_start_us":227,"threads_started":1}
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
I20260810 03:50:01.778815 15861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.748546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50308 (local address 127.22.134.252:33015)
0810 03:50:01.749187 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.749213 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.757251 (+ 8038us) server_negotiation.cc:407] Connection header received
0810 03:50:01.758427 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.758456 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.758964 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.759368 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.760551 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.762392 (+ 1841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.763984 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.764707 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.765223 (+ 516us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.770548 (+ 5325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.770552 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.770555 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.770585 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.773800 (+ 3215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.774342 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.774350 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.774359 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.774499 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.774833 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.774836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.774838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.775402 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.776289 (+ 887us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.776421 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.776770 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":80,"server-negotiator.queue_time_us":376,"thread_start_us":193,"threads_started":1}
I20260810 03:50:01.779870 15858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:01.783749 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.763353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50310)
0810 03:50:01.763541 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.763562 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.763671 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.764028 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.764031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.764226 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.764299 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.764304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.765340 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.765344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.766045 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.766059 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.766628 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.766632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.766723 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.767367 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.767381 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.770273 (+ 2892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.781775 (+ 11502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.781779 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.781783 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.782075 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.782531 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.782535 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.782537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.782638 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.783177 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.783181 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.783288 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.783409 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.783563 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260810 03:50:01.783782 15863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.763443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50310 (local address 127.22.134.252:33015)
0810 03:50:01.763820 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.763828 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.763840 (+ 12us) server_negotiation.cc:407] Connection header received
0810 03:50:01.763878 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.763880 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.763913 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.764010 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.764452 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.765209 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.766213 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.766521 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.766632 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.770469 (+ 3837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.770478 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.770498 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.770538 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.781633 (+ 11095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.782239 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.782243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.782245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.782365 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.782773 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.782777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.782779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.783069 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.783175 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.783468 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.783608 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":299,"thread_start_us":116,"threads_started":1}
I20260810 03:50:01.786757 15866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.772961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50322 (local address 127.22.134.252:33015)
0810 03:50:01.773489 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.773497 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.773512 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:50:01.773562 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.773567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.773615 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.774260 (+ 645us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.774378 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.775168 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.776248 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.776555 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.777079 (+ 524us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.779039 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.779042 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.779045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.779068 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.780943 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.785131 (+ 4188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.785137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.785140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.785248 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.785586 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.785589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.785591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.785780 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.785871 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.786475 (+ 604us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.786596 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":338,"threads_started":1}
I20260810 03:50:01.786778 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.772609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50322)
0810 03:50:01.772833 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.772849 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.772934 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.773797 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.773801 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.773992 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.774135 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.774143 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.775299 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.775302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.776109 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.776121 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.776706 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.776711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.776829 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.777414 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.777428 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.778924 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.781063 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.781066 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.781068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.781877 (+ 809us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.785371 (+ 3494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.785376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.785377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.785476 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.785953 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.785957 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.786207 (+ 250us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.786348 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.786519 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260810 03:50:01.787478 15688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318: Bootstrap starting.
I20260810 03:50:01.789636 15773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70: Bootstrap starting.
I20260810 03:50:01.790668 15688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318: Neither blocks nor log segments found. Creating new log.
I20260810 03:50:01.791477 15688 log.cc:824] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318: Log is configured to *not* fsync() on all Append() calls
I20260810 03:50:01.791935 15773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70: Neither blocks nor log segments found. Creating new log.
I20260810 03:50:01.792955 15773 log.cc:824] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70: Log is configured to *not* fsync() on all Append() calls
I20260810 03:50:01.794181 15688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318: No bootstrap required, opened a new log
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
I20260810 03:50:01.795266 15773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70: No bootstrap required, opened a new log
I20260810 03:50:01.799567 15688 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } }
I20260810 03:50:01.799564 15773 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } }
I20260810 03:50:01.799819 15688 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84907f04fd4a4442807b8f4fb594c318, State: Initialized, Role: FOLLOWER
I20260810 03:50:01.799916 15773 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a72fa471c5b440d96068070b199ff70, State: Initialized, Role: FOLLOWER
I20260810 03:50:01.800194 15773 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } }
I20260810 03:50:01.800318 15693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.781643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33514 (local address 127.22.134.254:38337)
0810 03:50:01.781786 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.781791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.781803 (+ 12us) server_negotiation.cc:407] Connection header received
0810 03:50:01.781840 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.781846 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.781894 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.781992 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.782739 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.783457 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.784538 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.784888 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.784992 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.795646 (+ 10654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.795651 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.795654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.795687 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.797944 (+ 2257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.798594 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.798599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.798601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.798700 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.799082 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.799085 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.799087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.799337 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.799514 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.799912 (+ 398us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.800075 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 03:50:01.800556 15781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.780800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34876 (local address 127.22.134.253:45937)
0810 03:50:01.780941 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.780946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.781008 (+ 62us) server_negotiation.cc:407] Connection header received
0810 03:50:01.781173 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.781176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.781230 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.781283 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.782102 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.782888 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.784578 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.785038 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.785152 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.795655 (+ 10503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.795659 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.795662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.795687 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.797972 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.798600 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.798616 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.798618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.798700 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.799077 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.799081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.799083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.799384 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.799458 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.800053 (+ 595us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.800181 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 03:50:01.801056 15869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.801249 15862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.780440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:45937 (local address 127.0.0.1:34876)
0810 03:50:01.780937 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.780951 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.781070 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.781436 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.781441 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.781845 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.781963 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.781971 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.783016 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.783019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.783832 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.783842 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.785308 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.785316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.785419 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.793792 (+ 8373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.793816 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.795393 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.798130 (+ 2737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.798134 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.798136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.798463 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.798848 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.798852 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.798854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.798945 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.799562 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.799565 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.799689 (+ 124us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.800875 (+ 1186us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.801065 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420}
I20260810 03:50:01.801213 15869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:01.802201 15773 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:50:01.802275 15858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:01.800192 15688 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } }
I20260810 03:50:01.803720 15688 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: configured and running, proceeding with master startup.
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
Aug 10 03:50:01 dist-test-slave-qg60 krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
I20260810 03:50:01.806516 15696 master_runner.cc:186] Error getting master registration for 127.22.134.254:38337: OK, instance_id { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" instance_seqno: 1786333801287674 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:50:01.810283 15696 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 03:50:01.811810 15882 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 03:50:01.807447 15870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.812482 15870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:01.813712 15862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.802889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:33015 (local address 127.0.0.1:50334)
0810 03:50:01.802987 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:01.803002 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:01.803082 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:01.803361 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:01.803364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:01.803580 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:01.803697 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.803707 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.804971 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.804974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.805864 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:01.805874 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.806672 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.806676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:01.806763 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.807343 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:01.807359 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:01.809860 (+ 2501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:01.811960 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.811962 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.811964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.812290 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.812570 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:01.812573 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:01.812575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:01.812657 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:01.813212 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:01.813217 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:01.813310 (+ 93us) client_negotiation.cc:769] Sending connection context
0810 03:50:01.813410 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 03:50:01.813551 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 03:50:01.814159 15882 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:50:01.814196 15866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.803042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50334 (local address 127.22.134.252:33015)
0810 03:50:01.803161 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.803167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.803181 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:50:01.803216 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.803218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.803266 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.803354 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.803841 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.804852 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.805992 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.806389 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.806495 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.810016 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.810020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.810023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.810047 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.811849 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.812396 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.812400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.812402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.812480 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.812791 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.812794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.812796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.813063 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.813174 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.813909 (+ 735us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.814029 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260810 03:50:01.816627 15894 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:50:01.816732 15894 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:50:01.815426 15781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.802142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34884 (local address 127.22.134.253:45937)
0810 03:50:01.802275 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.802280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.802296 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:50:01.802336 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.802339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.802385 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.802469 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.804375 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.805181 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.806362 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.806702 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.806777 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.810915 (+ 4138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.810919 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.810921 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.810950 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.812947 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.813510 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.813514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.813516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.813610 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.813956 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.813960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.813962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.814211 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.814440 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.815138 (+ 698us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.815278 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:50:01.818045 15858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09: Bootstrap starting.
I20260810 03:50:01.820250 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:50:01.820925 15858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09: Neither blocks nor log segments found. Creating new log.
I20260810 03:50:01.821827 15858 log.cc:824] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09: Log is configured to *not* fsync() on all Append() calls
I20260810 03:50:01.822037 15658 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "84907f04fd4a4442807b8f4fb594c318"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33514
I20260810 03:50:01.822399 15658 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 03:50:01.822538 15658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:50:01.824121 15658 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } }
I20260810 03:50:01.825546 15658 leader_election.cc:288] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [CANDIDATE]: Term 1 election: Requested vote from peers 8a72fa471c5b440d96068070b199ff70 (127.22.134.253:45937), afb21393578b47e1b748997a1bbb1f09 (127.22.134.252:33015)
I20260810 03:50:01.826257 15742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "84907f04fd4a4442807b8f4fb594c318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8a72fa471c5b440d96068070b199ff70"
I20260810 03:50:01.826560 15742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:50:01.828040 15858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09: No bootstrap required, opened a new log
I20260810 03:50:01.828052 15742 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84907f04fd4a4442807b8f4fb594c318 in term 1.
I20260810 03:50:01.822631 15610 master_runner.cc:186] Error getting master registration for 127.22.134.252:33015: OK, instance_id { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" instance_seqno: 1786333801741088 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:50:01.829416 15610 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:50:01.829017 15631 leader_election.cc:302] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84907f04fd4a4442807b8f4fb594c318, 8a72fa471c5b440d96068070b199ff70; no voters:
I20260810 03:50:01.829778 15870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:50:01.830129 15870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [term 1 LEADER]: Becoming Leader. State: Replica: 84907f04fd4a4442807b8f4fb594c318, State: Running, Role: LEADER
I20260810 03:50:01.830513 15870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } }
I20260810 03:50:01.832662 15870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84907f04fd4a4442807b8f4fb594c318. Latest consensus state: current_term: 1 leader_uuid: "84907f04fd4a4442807b8f4fb594c318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.833292 15858 raft_consensus.cc:348] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } }
I20260810 03:50:01.833540 15870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: This master's current role is: LEADER
I20260810 03:50:01.833549 15858 raft_consensus.cc:729] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb21393578b47e1b748997a1bbb1f09, State: Initialized, Role: FOLLOWER
I20260810 03:50:01.833884 15858 consensus_queue.cc:260] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } }
I20260810 03:50:01.835304 15858 sys_catalog.cc:564] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:50:01.836795 15830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "84907f04fd4a4442807b8f4fb594c318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "afb21393578b47e1b748997a1bbb1f09"
I20260810 03:50:01.837046 15830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:50:01.837221 15906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:50:01.838337 15906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:50:01.838397 15830 raft_consensus.cc:2454] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84907f04fd4a4442807b8f4fb594c318 in term 1.
W20260810 03:50:01.843299 15919 catalog_manager.cc:1558] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:50:01.843405 15919 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:50:01.843667 15907 sys_catalog.cc:455] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.843794 15907 sys_catalog.cc:458] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:01.853979 15830 raft_consensus.cc:1261] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [term 1 FOLLOWER]: Refusing update from remote peer 84907f04fd4a4442807b8f4fb594c318: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:50:01.854125 15742 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [term 1 FOLLOWER]: Refusing update from remote peer 84907f04fd4a4442807b8f4fb594c318: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:50:01.854697 15870 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:50:01.855159 15870 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:50:01.859676 15869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84907f04fd4a4442807b8f4fb594c318. Latest consensus state: current_term: 1 leader_uuid: "84907f04fd4a4442807b8f4fb594c318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.859836 15869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:01.864178 15907 sys_catalog.cc:455] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84907f04fd4a4442807b8f4fb594c318. Latest consensus state: current_term: 1 leader_uuid: "84907f04fd4a4442807b8f4fb594c318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.864333 15907 sys_catalog.cc:458] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:01.866693 15781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.841247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34894 (local address 127.22.134.253:45937)
0810 03:50:01.841494 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.841502 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.852263 (+ 10761us) server_negotiation.cc:407] Connection header received
0810 03:50:01.855588 (+ 3325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.855592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.855653 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.855716 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.856972 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.857861 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.859248 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.859648 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.859735 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.862327 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.862332 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.862335 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.862370 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.864343 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.865107 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.865112 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.865114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.865220 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.865570 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.865573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.865575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.865832 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.865955 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.866344 (+ 389us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.866503 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260810 03:50:01.871016 15920 mvcc.cc:205] Tried to move back new op lower bound from 7316823252381216768 to 7316823252302159872. Current Snapshot: MvccSnapshot[applied={T|T < 7316823252381216768}]
I20260810 03:50:01.871273 15870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "84907f04fd4a4442807b8f4fb594c318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.871398 15870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: This master's current role is: LEADER
I20260810 03:50:01.872210 15869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "84907f04fd4a4442807b8f4fb594c318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.872339 15869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:01.872669 15927 mvcc.cc:205] Tried to move back new op lower bound from 7316823252381216768 to 7316823252302159872. Current Snapshot: MvccSnapshot[applied={T|T < 7316823252381216768}]
I20260810 03:50:01.878392 15870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "84907f04fd4a4442807b8f4fb594c318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.878530 15870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318 [sys.catalog]: This master's current role is: LEADER
I20260810 03:50:01.879801 15907 sys_catalog.cc:455] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "84907f04fd4a4442807b8f4fb594c318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84907f04fd4a4442807b8f4fb594c318" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38337 } } peers { permanent_uuid: "8a72fa471c5b440d96068070b199ff70" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 45937 } } peers { permanent_uuid: "afb21393578b47e1b748997a1bbb1f09" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 33015 } } }
I20260810 03:50:01.879925 15907 sys_catalog.cc:458] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:01.880573 15929 mvcc.cc:205] Tried to move back new op lower bound from 7316823252381216768 to 7316823252302159872. Current Snapshot: MvccSnapshot[applied={T|T < 7316823252381216768}]
I20260810 03:50:01.885775 15866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.845064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50338 (local address 127.22.134.252:33015)
0810 03:50:01.845198 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.845203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.868162 (+ 22959us) server_negotiation.cc:407] Connection header received
0810 03:50:01.868366 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.868370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.868428 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.868503 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.869749 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.870642 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.873001 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.873378 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.873458 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.878266 (+ 4808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.878270 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.878273 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.878304 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.880396 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.883652 (+ 3256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.883657 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.883659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.883758 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.884087 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.884091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.884093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.884354 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.884529 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.885428 (+ 899us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.885592 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:50:01.889792 15693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:01.841633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33518 (local address 127.22.134.254:38337)
0810 03:50:01.841761 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.841766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.852518 (+ 10752us) server_negotiation.cc:407] Connection header received
0810 03:50:01.852677 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.852680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.852775 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.852869 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.873739 (+ 20870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.874433 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.875639 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:01.875990 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:01.876087 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:01.881173 (+ 5086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:01.881177 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:01.881181 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:01.881213 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:01.883082 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.884938 (+ 1856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.884942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.884945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.885047 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:01.886307 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:01.886311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:01.886313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:01.886776 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:01.886910 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:01.889452 (+ 2542us) server_negotiation.cc:299] Negotiation successful
0810 03:50:01.889607 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 03:50:01.891783 15906 catalog_manager.cc:1347] Generated new cluster ID: 30bec755d5b940699f49bff9cd4497a8
I20260810 03:50:01.891860 15906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:50:01.917074 15906 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:50:01.918221 15906 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:50:01.935875 15906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84907f04fd4a4442807b8f4fb594c318: Generated new TSK 0
I20260810 03:50:01.936936 15906 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:50:01.974999 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:01.971139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34898 (local address 127.22.134.253:45937)
0810 03:50:01.971283 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.971289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.973687 (+ 2398us) server_negotiation.cc:407] Connection header received
0810 03:50:01.973908 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.973913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.973972 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.974037 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.974844 (+ 807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34898: BlockingRecv error: recv got EOF from 127.0.0.1:34898 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260810 03:50:01.977921 15693 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:01.972170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33530 (local address 127.22.134.254:38337)
0810 03:50:01.972303 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.972307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.975776 (+ 3469us) server_negotiation.cc:407] Connection header received
0810 03:50:01.976644 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.976648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.976706 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.976793 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.977768 (+ 975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33530: BlockingRecv error: recv got EOF from 127.0.0.1:33530 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260810 03:50:01.978948 15866 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:01.972967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50342 (local address 127.22.134.252:33015)
0810 03:50:01.973090 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.973095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.976313 (+ 3218us) server_negotiation.cc:407] Connection header received
0810 03:50:01.976953 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.976957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.977024 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.977086 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.978819 (+ 1733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50342: BlockingRecv error: recv got EOF from 127.0.0.1:50342 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 03:50:01.984697 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:01.982850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34912 (local address 127.22.134.253:45937)
0810 03:50:01.982990 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.982995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.983551 (+ 556us) server_negotiation.cc:407] Connection header received
0810 03:50:01.983815 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.983822 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.983905 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.983964 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.984569 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34912: BlockingRecv error: recv got EOF from 127.0.0.1:34912 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260810 03:50:01.991289 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:01.989505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34924 (local address 127.22.134.253:45937)
0810 03:50:01.989631 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.989635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.990247 (+ 612us) server_negotiation.cc:407] Connection header received
0810 03:50:01.990458 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.990462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.990518 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.990575 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.991164 (+ 589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34924: BlockingRecv error: recv got EOF from 127.0.0.1:34924 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 03:50:01.997555 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:01.995722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34930 (local address 127.22.134.253:45937)
0810 03:50:01.995832 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:01.995836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:01.996422 (+ 586us) server_negotiation.cc:407] Connection header received
0810 03:50:01.996651 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:01.996655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:01.996747 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:01.996802 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:01.997433 (+ 631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34930: BlockingRecv error: recv got EOF from 127.0.0.1:34930 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260810 03:50:02.006462 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:02.004246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34938 (local address 127.22.134.253:45937)
0810 03:50:02.004416 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:02.004420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:02.005198 (+ 778us) server_negotiation.cc:407] Connection header received
0810 03:50:02.005518 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:02.005524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:02.005587 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:02.005667 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:02.006310 (+ 643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34938: BlockingRecv error: recv got EOF from 127.0.0.1:34938 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260810 03:50:02.019057 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:02.017106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34944 (local address 127.22.134.253:45937)
0810 03:50:02.017240 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:02.017246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:02.017921 (+ 675us) server_negotiation.cc:407] Connection header received
0810 03:50:02.018159 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:02.018163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:02.018223 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:02.018282 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:02.018921 (+ 639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34944: BlockingRecv error: recv got EOF from 127.0.0.1:34944 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260810 03:50:02.039587 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:02.037786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34946 (local address 127.22.134.253:45937)
0810 03:50:02.037916 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:02.037920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:02.038537 (+ 617us) server_negotiation.cc:407] Connection header received
0810 03:50:02.038754 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:02.038758 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:02.038815 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:02.038868 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:02.039444 (+ 576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34946: BlockingRecv error: recv got EOF from 127.0.0.1:34946 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 03:50:02.075554 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:02.074254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34960 (local address 127.22.134.253:45937)
0810 03:50:02.074427 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:02.074431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:02.074596 (+ 165us) server_negotiation.cc:407] Connection header received
0810 03:50:02.074780 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:02.074783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:02.074844 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:02.074912 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:02.075424 (+ 512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34960: BlockingRecv error: recv got EOF from 127.0.0.1:34960 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 03:50:02.143280 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:02.142006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34974 (local address 127.22.134.253:45937)
0810 03:50:02.142179 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:02.142183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:02.142305 (+ 122us) server_negotiation.cc:407] Connection header received
0810 03:50:02.142491 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:02.142501 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:02.142559 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:02.142657 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:02.143161 (+ 504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34974: BlockingRecv error: recv got EOF from 127.0.0.1:34974 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260810 03:50:02.275239 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:02.273838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34990 (local address 127.22.134.253:45937)
0810 03:50:02.274022 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:02.274027 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:02.274230 (+ 203us) server_negotiation.cc:407] Connection header received
0810 03:50:02.274440 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:02.274444 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:02.274533 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:02.274633 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:02.275126 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34990: BlockingRecv error: recv got EOF from 127.0.0.1:34990 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260810 03:50:02.535033 15781 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:02.533653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34994 (local address 127.22.134.253:45937)
0810 03:50:02.533819 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:02.533824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:02.533960 (+ 136us) server_negotiation.cc:407] Connection header received
0810 03:50:02.534230 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:02.534237 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:02.534298 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:02.534399 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:02.534904 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34994: BlockingRecv error: recv got EOF from 127.0.0.1:34994 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 03:50:02.818496 15882 catalog_manager.cc:1259] Loaded cluster ID: 30bec755d5b940699f49bff9cd4497a8
I20260810 03:50:02.818650 15882 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70: loading cluster ID for follower catalog manager: success
I20260810 03:50:02.820904 15882 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70: acquiring CA information for follower catalog manager: success
I20260810 03:50:02.822139 15882 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8a72fa471c5b440d96068070b199ff70: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:50:02.844720 15919 catalog_manager.cc:1259] Loaded cluster ID: 30bec755d5b940699f49bff9cd4497a8
I20260810 03:50:02.844866 15919 catalog_manager.cc:1552] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09: loading cluster ID for follower catalog manager: success
I20260810 03:50:02.846550 15919 catalog_manager.cc:1574] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09: acquiring CA information for follower catalog manager: success
I20260810 03:50:02.847719 15919 catalog_manager.cc:1602] T 00000000000000000000000000000000 P afb21393578b47e1b748997a1bbb1f09: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:50:03.053826 16007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:03.049639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.22.134.253:45937)
0810 03:50:03.049923 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:03.049926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:03.049967 (+ 41us) server_negotiation.cc:407] Connection header received
0810 03:50:03.050033 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:03.050035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:03.050171 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:03.050274 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:03.050618 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.051217 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.052166 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.052397 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.052483 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:03.052823 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:03.053340 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:03.053438 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:03.053532 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 03:50:03.053593 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":120,"threads_started":1}
I20260810 03:50:03.061498 16013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:03.057546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50352 (local address 127.22.134.252:33015)
0810 03:50:03.057835 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:03.057840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:03.057855 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:50:03.057999 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:03.058002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:03.058125 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:03.058266 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:03.058495 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.059017 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.059856 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.060082 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.060196 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:03.060497 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:03.061046 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:03.061173 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:03.061271 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 03:50:03.061329 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":109,"threads_started":1}
I20260810 03:50:03.069337 16007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:03.064986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35000 (local address 127.22.134.253:45937)
0810 03:50:03.065180 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:03.065185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:03.065605 (+ 420us) server_negotiation.cc:407] Connection header received
0810 03:50:03.065771 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:03.065775 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:03.065849 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:03.065938 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:03.066187 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.066828 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.067931 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.068266 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.068338 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:03.068757 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:03.068852 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:03.068950 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:03.069109 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 03:50:03.069172 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260810 03:50:03.069752 16023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:03.064721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33546 (local address 127.22.134.254:38337)
0810 03:50:03.065206 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:03.065211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:03.065228 (+ 17us) server_negotiation.cc:407] Connection header received
0810 03:50:03.065337 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:03.065340 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:03.065533 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:03.065671 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:03.065940 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.066888 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.067979 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.068243 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.068363 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:03.068751 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:03.069148 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:03.069226 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:03.069523 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 03:50:03.069600 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":83,"threads_started":1}
I20260810 03:50:03.069947 16013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:03.065340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50360 (local address 127.22.134.252:33015)
0810 03:50:03.065473 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:03.065478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:03.065958 (+ 480us) server_negotiation.cc:407] Connection header received
0810 03:50:03.066131 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:03.066135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:03.066187 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:03.066273 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:03.066513 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.067316 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.068465 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:03.068864 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:03.068987 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:03.069356 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:03.069457 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:03.069541 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:03.069693 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 03:50:03.069759 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 03:50:03.073369 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 15610
I20260810 03:50:03.083104 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 15696
I20260810 03:50:03.090210 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 15783
2026-08-10T03:50:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3272 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 03:50:03 dist-test-slave-qg60 krb5kdc[16027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 03:50:03 dist-test-slave-qg60 krb5kdc[16027](info): set up 2 sockets
Aug 10 03:50:03 dist-test-slave-qg60 krb5kdc[16027](info): commencing operation
krb5kdc: starting...
W20260810 03:50:04.245589 23067 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/test-user.keytab.
Aug 10 03:50:04 dist-test-slave-qg60 krb5kdc[16027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T03:50:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T03:50:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.134.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
Entry for principal kudu/127.22.134.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab.
I20260810 03:50:04.380508 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38329
--webserver_interface=127.22.134.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:41987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38329,127.22.134.253:36277,127.22.134.252:38459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 03:50:04.493472 16043 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:50:04.493848 16043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:50:04.493925 16043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:50:04.494009 16043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:50:04.498288 16043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:50:04.498392 16043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:50:04.498433 16043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:50:04.498472 16043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:50:04.498507 16043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:50:04.504103 16043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:41987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38329,127.22.134.253:36277,127.22.134.252:38459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.254.keytab
--principal=kudu/127.22.134.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.254:38329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.134.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:50:04.505326 16043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:50:04.506376 16043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:50:04.515287 16051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:04.515311 16052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:04.515287 16054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:50:04.515807 16043 server_base.cc:1034] running on GCE node
I20260810 03:50:04.516402 16043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:50:04.517680 16043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:50:04.518887 16043 hybrid_clock.cc:648] HybridClock initialized: now 1786333804518815 us; error 82 us; skew 500 ppm
Aug 10 03:50:04 dist-test-slave-qg60 krb5kdc[16027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:50:04.522270 16043 init.cc:377] Logged in from keytab as kudu/127.22.134.254@KRBTEST.COM (short username kudu)
I20260810 03:50:04.523353 16043 webserver.cc:460] Webserver started at http://127.22.134.254:37949/ using document root <none> and password file <none>
I20260810 03:50:04.523962 16043 fs_manager.cc:359] Metadata directory not provided
I20260810 03:50:04.524060 16043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:50:04.524312 16043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:50:04.526556 16043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/data/instance:
uuid: "8b817639f5114048b4e11e5e031e56cb"
format_stamp: "Formatted at 2026-08-10 03:50:04 on dist-test-slave-qg60"
server_key: "41578867e81ab979b71c6537e6e61f06"
server_key_iv: "a589624ae327f87efc2ca8716bd14278"
server_key_version: "encryptionkey@0"
I20260810 03:50:04.527172 16043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/wal/instance:
uuid: "8b817639f5114048b4e11e5e031e56cb"
format_stamp: "Formatted at 2026-08-10 03:50:04 on dist-test-slave-qg60"
server_key: "41578867e81ab979b71c6537e6e61f06"
server_key_iv: "a589624ae327f87efc2ca8716bd14278"
server_key_version: "encryptionkey@0"
I20260810 03:50:04.531195 16043 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 03:50:04.533834 16061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:50:04.535372 16043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:50:04.535552 16043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/wal
uuid: "8b817639f5114048b4e11e5e031e56cb"
format_stamp: "Formatted at 2026-08-10 03:50:04 on dist-test-slave-qg60"
server_key: "41578867e81ab979b71c6537e6e61f06"
server_key_iv: "a589624ae327f87efc2ca8716bd14278"
server_key_version: "encryptionkey@0"
I20260810 03:50:04.535686 16043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:50:04.567173 16043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:50:04.570358 16043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:50:04.570595 16043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:50:04.579399 16043 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.254:38329
I20260810 03:50:04.579711 16122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.254:38329 every 8 connection(s)
I20260810 03:50:04.580438 16043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/data/info.pb
I20260810 03:50:04.583340 16123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:50:04.587226 16123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:04.588019 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 16043
I20260810 03:50:04.588147 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-0/wal/instance
I20260810 03:50:04.588451 23067 external_mini_cluster.cc:1428] Setting key 6b7da24dc23093539d364f1dcccc352c
WARNING: no policy specified for kudu/127.22.134.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.253@KRBTEST.COM" created.
Aug 10 03:50:04 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:50:04.607921 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.589970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38329 (local address 127.0.0.1:52760)
0810 03:50:04.590558 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.590618 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:04.591640 (+ 1022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:04.592454 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:04.592459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:04.592961 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:04.593266 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:04.593282 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.595119 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.595122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:04.596115 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:04.596126 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.597115 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.597119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:04.597222 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:04.597856 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:04.597873 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:04.602090 (+ 4217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:04.604241 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:04.604250 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:04.604261 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:04.604498 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:04.604886 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:04.604889 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:04.604890 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:04.605012 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:04.605970 (+ 958us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:04.605977 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:04.606158 (+ 181us) client_negotiation.cc:769] Sending connection context
0810 03:50:04.606357 (+ 199us) client_negotiation.cc:240] Negotiation successful
0810 03:50:04.606821 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":133,"thread_start_us":173,"threads_started":1}
I20260810 03:50:04.607921 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.590953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52760 (local address 127.22.134.254:38329)
0810 03:50:04.591308 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:04.591323 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:04.591378 (+ 55us) server_negotiation.cc:407] Connection header received
0810 03:50:04.591962 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:04.591971 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:04.592223 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:04.592427 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:04.593438 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.594969 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.596250 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.596925 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.597111 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:04.602255 (+ 5144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:04.602263 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:04.602277 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:04.602308 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:04.604103 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:04.604611 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:04.604617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:04.604619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:04.604773 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:04.605107 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:04.605112 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:04.605114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:04.605823 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:04.605990 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:04.606432 (+ 442us) server_negotiation.cc:299] Negotiation successful
0810 03:50:04.606731 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":121,"threads_started":1}
I20260810 03:50:04.611446 16123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:04.612483 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.612110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41932)
0810 03:50:04.612248 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.612343 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 03:50:04.612818 16067 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
I20260810 03:50:04.613984 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.613733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41942)
0810 03:50:04.613857 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.613919 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 03:50:04.614204 16123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:36277: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab.
Entry for principal kudu/127.22.134.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab.
I20260810 03:50:04.620255 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.253:36277
--webserver_interface=127.22.134.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab
--principal=kudu/127.22.134.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:41987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38329,127.22.134.253:36277,127.22.134.252:38459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:50:04.663542 16123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } attempt: 1
I20260810 03:50:04.664604 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.664296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41950)
0810 03:50:04.664458 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.664522 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260810 03:50:04.665464 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.665221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41952)
0810 03:50:04.665343 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.665399 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 03:50:04.665647 16123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:36277: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
I20260810 03:50:04.733852 16123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } attempt: 2
I20260810 03:50:04.734802 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.734462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41962)
0810 03:50:04.734657 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.734721 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260810 03:50:04.735535 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.735325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41970)
0810 03:50:04.735432 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.735483 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 03:50:04.735653 16123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.253:36277: Network error: Client connection negotiation failed: client connection to 127.22.134.253:36277: connect: Connection refused (error 111)
W20260810 03:50:04.743285 16131 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:50:04.743752 16131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:50:04.743809 16131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:50:04.743886 16131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 03:50:04.750362 16131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:50:04.750459 16131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:50:04.750501 16131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:50:04.750535 16131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:50:04.750568 16131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:50:04.756877 16131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:41987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38329,127.22.134.253:36277,127.22.134.252:38459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.253.keytab
--principal=kudu/127.22.134.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.253:36277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.134.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:50:04.758051 16131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:50:04.759045 16131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:50:04.767930 16137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:04.767915 16138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:04.767879 16140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:50:04.768210 16131 server_base.cc:1034] running on GCE node
I20260810 03:50:04.768885 16131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:50:04.770059 16131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:50:04.771255 16131 hybrid_clock.cc:648] HybridClock initialized: now 1786333804771224 us; error 47 us; skew 500 ppm
Aug 10 03:50:04 dist-test-slave-qg60 krb5kdc[16027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:50:04.774228 16131 init.cc:377] Logged in from keytab as kudu/127.22.134.253@KRBTEST.COM (short username kudu)
I20260810 03:50:04.775079 16131 webserver.cc:460] Webserver started at http://127.22.134.253:34337/ using document root <none> and password file <none>
I20260810 03:50:04.775605 16131 fs_manager.cc:359] Metadata directory not provided
I20260810 03:50:04.775671 16131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:50:04.775854 16131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:50:04.777940 16131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/data/instance:
uuid: "97002f4034894aef89e2d21f860e72c1"
format_stamp: "Formatted at 2026-08-10 03:50:04 on dist-test-slave-qg60"
server_key: "a83725c04ec89da9f66135cf8725f2a6"
server_key_iv: "0b4ff90fa762b60400e806d0daf07204"
server_key_version: "encryptionkey@0"
I20260810 03:50:04.778465 16131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/wal/instance:
uuid: "97002f4034894aef89e2d21f860e72c1"
format_stamp: "Formatted at 2026-08-10 03:50:04 on dist-test-slave-qg60"
server_key: "a83725c04ec89da9f66135cf8725f2a6"
server_key_iv: "0b4ff90fa762b60400e806d0daf07204"
server_key_version: "encryptionkey@0"
I20260810 03:50:04.782279 16131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 03:50:04.785092 16149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:50:04.786526 16131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 03:50:04.786635 16131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/wal
uuid: "97002f4034894aef89e2d21f860e72c1"
format_stamp: "Formatted at 2026-08-10 03:50:04 on dist-test-slave-qg60"
server_key: "a83725c04ec89da9f66135cf8725f2a6"
server_key_iv: "0b4ff90fa762b60400e806d0daf07204"
server_key_version: "encryptionkey@0"
I20260810 03:50:04.786734 16131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:50:04.809271 16131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:50:04.812927 16131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:50:04.813087 16131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:50:04.820531 16131 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.253:36277
I20260810 03:50:04.820919 16206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.253:36277 every 8 connection(s)
I20260810 03:50:04.821689 16131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/data/info.pb
I20260810 03:50:04.824815 16207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:50:04.826825 16123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } attempt: 3
I20260810 03:50:04.828719 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 16131
I20260810 03:50:04.828889 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-1/wal/instance
I20260810 03:50:04.829241 23067 external_mini_cluster.cc:1428] Setting key 821d0fea64e2b783dc4b1fe5ad0fd88c
I20260810 03:50:04.829363 16207 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:50:04 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
Aug 10 03:50:04 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.134.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.134.252@KRBTEST.COM" created.
I20260810 03:50:04.844403 16209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.828012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41978 (local address 127.22.134.253:36277)
0810 03:50:04.828473 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:04.828496 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:04.828544 (+ 48us) server_negotiation.cc:407] Connection header received
0810 03:50:04.829557 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:04.829582 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:04.830050 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:04.830503 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:04.831044 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.832717 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.833710 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.834532 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.834725 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:04.837825 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:04.837834 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:04.837852 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:04.837886 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:04.840313 (+ 2427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:04.841334 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:04.841339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:04.841345 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:04.841456 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:04.841789 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:04.841792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:04.841793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:04.842381 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:04.842539 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:04.842912 (+ 373us) server_negotiation.cc:299] Negotiation successful
0810 03:50:04.843250 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":156,"threads_started":1}
I20260810 03:50:04.845009 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.827382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41978)
0810 03:50:04.827572 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.827607 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:04.827730 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:04.830476 (+ 2746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:04.830480 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:04.830727 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:04.830883 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:04.830893 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.832878 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.832882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:04.833570 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:04.833589 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.834678 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.834683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:04.834795 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:04.835439 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:04.835464 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:04.837648 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:04.840436 (+ 2788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:04.840442 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:04.840448 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:04.840867 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:04.841567 (+ 700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:04.841571 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:04.841573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:04.841680 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:04.842501 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:04.842504 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:04.842625 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 03:50:04.842741 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 03:50:04.842895 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 03:50:04.847051 16123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:04.847533 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.831692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38329 (local address 127.0.0.1:52762)
0810 03:50:04.832147 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.832198 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:04.832353 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:04.832703 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:04.832709 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:04.833258 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:04.833443 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:04.833454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.834305 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.834309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:04.835271 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:04.835285 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.836081 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.836086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:04.836235 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:04.837455 (+ 1220us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:04.837479 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:04.839574 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:04.842138 (+ 2564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:04.842149 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:04.842156 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:04.842472 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:04.842932 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:04.842937 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:04.842939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:04.843038 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:04.846746 (+ 3708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:04.846757 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:04.846897 (+ 140us) client_negotiation.cc:769] Sending connection context
0810 03:50:04.847083 (+ 186us) client_negotiation.cc:240] Negotiation successful
0810 03:50:04.847308 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":3,"thread_start_us":167,"threads_started":1}
I20260810 03:50:04.847568 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.831692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52762 (local address 127.22.134.254:38329)
0810 03:50:04.831804 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:04.831809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:04.832272 (+ 463us) server_negotiation.cc:407] Connection header received
0810 03:50:04.832450 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:04.832452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:04.832494 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:04.832539 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:04.833585 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.834166 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.835430 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.835876 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.836008 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:04.839745 (+ 3737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:04.839749 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:04.839751 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:04.839775 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:04.842015 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:04.842678 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:04.842685 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:04.842690 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:04.842793 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:04.843154 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:04.843160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:04.843162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:04.846517 (+ 3355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:04.846670 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:04.847185 (+ 515us) server_negotiation.cc:299] Negotiation successful
0810 03:50:04.847341 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 03:50:04.848165 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.847618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59282)
0810 03:50:04.848015 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.848078 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321}
I20260810 03:50:04.849045 16207 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:04.849546 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.848764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59296)
0810 03:50:04.849443 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.849493 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":613}
W20260810 03:50:04.849754 16123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:38459: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Aug 10 03:50:04 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
I20260810 03:50:04.861519 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.849583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41994)
0810 03:50:04.849904 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.849918 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:04.850004 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:04.850298 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:04.850302 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:04.850537 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:04.850688 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:04.850700 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.851510 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.851515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:04.852406 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:04.852418 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.853021 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.853025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:04.853162 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:04.853690 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:04.853705 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:04.857508 (+ 3803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:04.859544 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:04.859550 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:04.859555 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:04.859861 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:04.860160 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:04.860162 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:04.860164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:04.860264 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:04.860830 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:04.860833 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:04.860954 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 03:50:04.861158 (+ 204us) client_negotiation.cc:240] Negotiation successful
0810 03:50:04.861289 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113}
I20260810 03:50:04.861519 16209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.849796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41994 (local address 127.22.134.253:36277)
0810 03:50:04.850111 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:04.850114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:04.850122 (+ 8us) server_negotiation.cc:407] Connection header received
0810 03:50:04.850145 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:04.850146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:04.850175 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:04.850232 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:04.850830 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.851390 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.852548 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:04.852889 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:04.852986 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:04.857683 (+ 4697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:04.857687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:04.857689 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:04.857713 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:04.859300 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:04.859953 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:04.859956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:04.859957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:04.860029 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:04.860419 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:04.860424 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:04.860426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:04.860628 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:04.860709 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:04.861229 (+ 520us) server_negotiation.cc:299] Negotiation successful
0810 03:50:04.861349 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":264}
I20260810 03:50:04.862448 16207 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.134.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab.
Entry for principal kudu/127.22.134.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab.
I20260810 03:50:04.863261 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.862957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59308)
0810 03:50:04.863070 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.863190 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 03:50:04.863775 16152 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
I20260810 03:50:04.864353 23067 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWYy72V/build/debug/bin/kudu
/tmp/dist-test-taskWYy72V/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.252:38459
--webserver_interface=127.22.134.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab
--principal=kudu/127.22.134.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.134.212:41987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.134.254:38329,127.22.134.253:36277,127.22.134.252:38459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 03:50:04.864837 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.864513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59312)
0810 03:50:04.864675 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.864758 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260810 03:50:04.865018 16207 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:38459: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
I20260810 03:50:04.880924 16123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } attempt: 1
I20260810 03:50:04.881866 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.881551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59318)
0810 03:50:04.881732 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.881792 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 03:50:04.882576 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.882362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59332)
0810 03:50:04.882471 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.882522 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 03:50:04.882709 16123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:38459: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
I20260810 03:50:04.914343 16207 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } attempt: 1
I20260810 03:50:04.915287 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.914975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59334)
0810 03:50:04.915140 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.915207 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 03:50:04.916157 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.915871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59346)
0810 03:50:04.916011 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.916071 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 03:50:04.916290 16207 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:38459: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
I20260810 03:50:04.957932 16123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } attempt: 2
I20260810 03:50:04.958897 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.958591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59362)
0810 03:50:04.958750 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.958819 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260810 03:50:04.959589 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.959373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59374)
0810 03:50:04.959483 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.959535 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 03:50:04.959710 16123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:38459: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
W20260810 03:50:04.980795 16214 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 03:50:04.981189 16214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 03:50:04.981254 16214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 03:50:04.981357 16214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 03:50:04.984464 16207 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } attempt: 2
I20260810 03:50:04.985375 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.985071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59384)
0810 03:50:04.985224 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.985297 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260810 03:50:04.985723 16214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 03:50:04.985798 16214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 03:50:04.985847 16214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 03:50:04.985906 16214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 03:50:04.985945 16214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 03:50:04.986168 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:04.985925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59394)
0810 03:50:04.986064 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:04.986106 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260810 03:50:04.986300 16207 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.134.252:38459: Network error: Client connection negotiation failed: client connection to 127.22.134.252:38459: connect: Connection refused (error 111)
I20260810 03:50:04.991834 16214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.134.212:41987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.134.254:38329,127.22.134.253:36277,127.22.134.252:38459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/krb5kdc/kudu_127.22.134.252.keytab
--principal=kudu/127.22.134.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.134.252:38459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.134.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 02:54:48 UTC on ccycloud.quasar-oaausp.root.comops.site
build id 4576979
I20260810 03:50:04.993070 16214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 03:50:04.994135 16214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 03:50:05.003538 16219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:05.003597 16220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 03:50:05.003526 16222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 03:50:05.004038 16214 server_base.cc:1034] running on GCE node
I20260810 03:50:05.004654 16214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 03:50:05.006003 16214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 03:50:05.007259 16214 hybrid_clock.cc:648] HybridClock initialized: now 1786333805007245 us; error 33 us; skew 500 ppm
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333805, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 03:50:05.010499 16214 init.cc:377] Logged in from keytab as kudu/127.22.134.252@KRBTEST.COM (short username kudu)
I20260810 03:50:05.011521 16214 webserver.cc:460] Webserver started at http://127.22.134.252:40579/ using document root <none> and password file <none>
I20260810 03:50:05.012080 16214 fs_manager.cc:359] Metadata directory not provided
I20260810 03:50:05.012152 16214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 03:50:05.012331 16214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 03:50:05.014600 16214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/data/instance:
uuid: "f1fae6fac9934fadb545c8a7c82f0d6b"
format_stamp: "Formatted at 2026-08-10 03:50:05 on dist-test-slave-qg60"
server_key: "d79afc8fdaed155bde97e89661485969"
server_key_iv: "4d28cd195446a75da0788bf78e255315"
server_key_version: "encryptionkey@0"
I20260810 03:50:05.015244 16214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/wal/instance:
uuid: "f1fae6fac9934fadb545c8a7c82f0d6b"
format_stamp: "Formatted at 2026-08-10 03:50:05 on dist-test-slave-qg60"
server_key: "d79afc8fdaed155bde97e89661485969"
server_key_iv: "4d28cd195446a75da0788bf78e255315"
server_key_version: "encryptionkey@0"
I20260810 03:50:05.019522 16214 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 03:50:05.022310 16234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 03:50:05.023590 16214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 03:50:05.023741 16214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/data,/tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/wal
uuid: "f1fae6fac9934fadb545c8a7c82f0d6b"
format_stamp: "Formatted at 2026-08-10 03:50:05 on dist-test-slave-qg60"
server_key: "d79afc8fdaed155bde97e89661485969"
server_key_iv: "4d28cd195446a75da0788bf78e255315"
server_key_version: "encryptionkey@0"
I20260810 03:50:05.023876 16214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 03:50:05.042462 16214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 03:50:05.046069 16214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 03:50:05.046301 16214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 03:50:05.053946 16214 rpc_server.cc:307] RPC server started. Bound to: 127.22.134.252:38459
I20260810 03:50:05.054263 16294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.134.252:38459 every 8 connection(s)
I20260810 03:50:05.055066 16214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/data/info.pb
I20260810 03:50:05.057928 16295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 03:50:05.058887 16123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } attempt: 3
I20260810 03:50:05.061954 23067 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWYy72V/build/debug/bin/kudu as pid 16214
I20260810 03:50:05.062121 23067 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWYy72V/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786333502007595-23067-0/minicluster-data/master-2/wal/instance
I20260810 03:50:05.062527 23067 external_mini_cluster.cc:1428] Setting key fdb0d6a5f0c73f71f4bdc2bc4b627343
I20260810 03:50:05.063570 16295 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.254@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333805, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:50:05.074635 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.059434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59410)
0810 03:50:05.059582 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:05.059601 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:05.059702 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:05.062203 (+ 2501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:05.062206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:05.062397 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:05.062505 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.062512 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.065014 (+ 2502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.065018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.065792 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.065807 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.066939 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.066945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.067044 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.067698 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:05.067718 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:05.069392 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:05.071987 (+ 2595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.072000 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.072002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.072234 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.072693 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.072945 (+ 252us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.072947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.073096 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.073888 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:05.073896 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:05.074039 (+ 143us) client_negotiation.cc:769] Sending connection context
0810 03:50:05.074174 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 03:50:05.074421 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 03:50:05.076373 16297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.060191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59410 (local address 127.22.134.252:38459)
0810 03:50:05.060679 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.060694 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.060771 (+ 77us) server_negotiation.cc:407] Connection header received
0810 03:50:05.061462 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.061479 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.061847 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.062748 (+ 901us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.063165 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.064853 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.065955 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.066737 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.066963 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.069604 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.069614 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.069632 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.069667 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.071870 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.072359 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.072365 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.072372 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.072558 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.073206 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.073210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.073212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.073774 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.073881 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.074501 (+ 620us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.075164 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":317,"thread_start_us":130,"threads_started":1}
I20260810 03:50:05.076838 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.065894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52768 (local address 127.22.134.254:38329)
0810 03:50:05.066041 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.066046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.066438 (+ 392us) server_negotiation.cc:407] Connection header received
0810 03:50:05.066647 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.066651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.066701 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.066788 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.067835 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.068365 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.069628 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.070025 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.070134 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.073115 (+ 2981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.073121 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.073128 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.073160 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.074937 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.075395 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.075398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.075400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.075486 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.075776 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.075781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.075783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.076105 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.076218 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.076537 (+ 319us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.076656 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 03:50:05.076907 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.065795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.254:38329 (local address 127.0.0.1:52768)
0810 03:50:05.066310 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:05.066363 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:05.066525 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:05.066870 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:05.066878 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:05.067414 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:05.067687 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.067697 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.068487 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.068493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.069492 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.069506 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.070259 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.070263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.070403 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.071076 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:05.071095 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:05.072965 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:05.075025 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.075035 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.075041 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.075283 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.075586 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.075589 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.075591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.075685 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.076216 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:05.076223 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:05.076338 (+ 115us) client_negotiation.cc:769] Sending connection context
0810 03:50:05.076481 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 03:50:05.076667 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":43,"thread_start_us":111,"threads_started":1}
I20260810 03:50:05.077466 16207 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } attempt: 3
I20260810 03:50:05.078308 16295 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:05.076390 16298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.063258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59424 (local address 127.22.134.252:38459)
0810 03:50:05.063727 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.063737 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.063811 (+ 74us) server_negotiation.cc:407] Connection header received
0810 03:50:05.063971 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.063975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.064024 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.064143 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.065168 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.065888 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.067022 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.067397 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.067577 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.071181 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.071185 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.071188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.071216 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.073587 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.074444 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.074448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.074450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.074545 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.074900 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.074904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.074906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.075123 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.075316 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.075998 (+ 682us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.076119 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":394,"thread_start_us":197,"threads_started":1}
I20260810 03:50:05.082098 16123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb: Bootstrap starting.
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333805, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.253@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
I20260810 03:50:05.085920 16123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb: Neither blocks nor log segments found. Creating new log.
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.254@KRBTEST.COM
I20260810 03:50:05.086949 16123 log.cc:824] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb: Log is configured to *not* fsync() on all Append() calls
I20260810 03:50:05.089371 16123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb: No bootstrap required, opened a new log
I20260810 03:50:05.091418 16209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.079623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41996 (local address 127.22.134.253:36277)
0810 03:50:05.079741 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.079746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.079761 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:50:05.079800 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.079803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.079852 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.079946 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.080515 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.081247 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.082494 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.082797 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.082876 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.086636 (+ 3760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.086642 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.086646 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.086685 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.088977 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.089711 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.089716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.089721 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.089821 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.090206 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.090213 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.090216 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.090568 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.090645 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.091103 (+ 458us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.091232 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 03:50:05.091471 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.080337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.22.134.254:38329)
0810 03:50:05.080456 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.080460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.080598 (+ 138us) server_negotiation.cc:407] Connection header received
0810 03:50:05.080719 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.080747 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.080796 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.080907 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.081568 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.082400 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.083612 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.083980 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.084099 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.087126 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.087131 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.087135 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.087166 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.089034 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.089548 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.089552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.089553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.089639 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.090016 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.090020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.090021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.090240 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.090427 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.091185 (+ 758us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.091309 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 03:50:05.091655 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.078061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59430 (local address 127.22.134.252:38459)
0810 03:50:05.078368 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.078377 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.078392 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:50:05.078480 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.078483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.078524 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.078615 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.079157 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.081461 (+ 2304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.082666 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.083045 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.083489 (+ 444us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.086143 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.086147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.086150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.086178 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.089451 (+ 3273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.090079 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.090082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.090084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.090166 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.090494 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.090497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.090499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.090730 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.091243 (+ 513us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.091320 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.091441 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":242,"thread_start_us":127,"threads_started":1}
I20260810 03:50:05.092404 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.078097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59430)
0810 03:50:05.078285 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:05.078300 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:05.078386 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:05.078645 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:05.078650 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:05.078882 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:05.078999 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.079007 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.081611 (+ 2604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.081615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.082527 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.082540 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.083185 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.083189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.083280 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.083828 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:05.083847 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:05.085917 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:05.089612 (+ 3695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.089618 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.089624 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.089917 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.090280 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.090286 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.090288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.090366 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.090847 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:05.090850 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:05.090949 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 03:50:05.091054 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 03:50:05.092252 (+ 1198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":980}
I20260810 03:50:05.093613 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.079541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.253:36277 (local address 127.0.0.1:41996)
0810 03:50:05.079642 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:05.079660 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:05.079733 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:05.079965 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:05.079972 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:05.080161 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:05.080308 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.080318 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.081628 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.081631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.082353 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.082364 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.083029 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.083033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.083123 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.083662 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:05.083675 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:05.086443 (+ 2768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:05.089129 (+ 2686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.089136 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.089140 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.089597 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.089982 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.089987 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.089989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.090087 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.090758 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:05.090765 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:05.090862 (+ 97us) client_negotiation.cc:769] Sending connection context
0810 03:50:05.093233 (+ 2371us) client_negotiation.cc:240] Negotiation successful
0810 03:50:05.093396 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":3}
I20260810 03:50:05.094394 16295 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } has no permanent_uuid. Determining permanent_uuid...
I20260810 03:50:05.094841 16123 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } }
I20260810 03:50:05.095064 16123 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b817639f5114048b4e11e5e031e56cb, State: Initialized, Role: FOLLOWER
I20260810 03:50:05.095405 16123 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } }
I20260810 03:50:05.095798 16207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1: Bootstrap starting.
I20260810 03:50:05.096840 16123 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: configured and running, proceeding with master startup.
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.134.253@KRBTEST.COM
I20260810 03:50:05.098721 16207 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1: Neither blocks nor log segments found. Creating new log.
I20260810 03:50:05.099673 16207 log.cc:824] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1: Log is configured to *not* fsync() on all Append() calls
I20260810 03:50:05.103415 16209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.092986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42000 (local address 127.22.134.253:36277)
0810 03:50:05.093113 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.093118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.093131 (+ 13us) server_negotiation.cc:407] Connection header received
0810 03:50:05.093166 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.093169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.093219 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.093299 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.094196 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.094888 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.095731 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.095971 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.096091 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.099058 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.099062 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.099064 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.099089 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.101222 (+ 2133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.101778 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.101782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.101784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.101877 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.102244 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.102247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.102249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.102495 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.102685 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.103112 (+ 427us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.103241 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 03:50:05.103998 16315 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:50:05.104094 16315 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:50:05.104372 16304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.104513 16304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:05.106441 16207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1: No bootstrap required, opened a new log
Aug 10 03:50:05 dist-test-slave-qg60 krb5kdc[16027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786333805, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.134.252@KRBTEST.COM for kudu/127.22.134.252@KRBTEST.COM
I20260810 03:50:05.102486 16043 master_runner.cc:186] Error getting master registration for 127.22.134.253:36277: OK, instance_id { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" instance_seqno: 1786333804818468 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:50:05.107079 16043 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:50:05.111127 23067 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 03:50:05.110976 16207 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } }
I20260810 03:50:05.111245 16207 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97002f4034894aef89e2d21f860e72c1, State: Initialized, Role: FOLLOWER
I20260810 03:50:05.111330 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.100767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.134.252:38459 (local address 127.0.0.1:59436)
0810 03:50:05.100901 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 03:50:05.100917 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 03:50:05.101024 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 03:50:05.101535 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 03:50:05.101538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 03:50:05.101735 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 03:50:05.101822 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.101828 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.102797 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.102800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.103527 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 03:50:05.103539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.104557 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.104562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 03:50:05.104658 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.105444 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 03:50:05.105460 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 03:50:05.107126 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 03:50:05.109246 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.109249 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.109251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.109524 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.109870 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 03:50:05.109874 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 03:50:05.109876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 03:50:05.109980 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 03:50:05.110769 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 03:50:05.110772 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 03:50:05.110874 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 03:50:05.110987 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 03:50:05.111133 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 03:50:05.111793 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.100817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59436 (local address 127.22.134.252:38459)
0810 03:50:05.101304 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.101309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.101323 (+ 14us) server_negotiation.cc:407] Connection header received
0810 03:50:05.101361 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.101366 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.101412 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.101524 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.101941 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.102681 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.104052 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.104404 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.104516 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.107293 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.107296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.107299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.107322 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.109127 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.109649 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.109653 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.109655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.109747 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.110381 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.110384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.110386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.110653 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.110767 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.111529 (+ 762us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.111656 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411}
I20260810 03:50:05.112630 16094 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8b817639f5114048b4e11e5e031e56cb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52774
I20260810 03:50:05.112928 16094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 03:50:05.113054 16094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:50:05.114449 16094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } }
I20260810 03:50:05.115224 16295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b: Bootstrap starting.
I20260810 03:50:05.115540 16094 leader_election.cc:288] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [CANDIDATE]: Term 1 election: Requested vote from peers 97002f4034894aef89e2d21f860e72c1 (127.22.134.253:36277), f1fae6fac9934fadb545c8a7c82f0d6b (127.22.134.252:38459)
I20260810 03:50:05.116436 16207 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } }
I20260810 03:50:05.118005 16207 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:50:05.118338 16295 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b: Neither blocks nor log segments found. Creating new log.
I20260810 03:50:05.118806 16178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b817639f5114048b4e11e5e031e56cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "97002f4034894aef89e2d21f860e72c1"
I20260810 03:50:05.119050 16178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:50:05.119300 16295 log.cc:824] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b: Log is configured to *not* fsync() on all Append() calls
I20260810 03:50:05.120600 16178 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b817639f5114048b4e11e5e031e56cb in term 1.
I20260810 03:50:05.121363 16067 leader_election.cc:302] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b817639f5114048b4e11e5e031e56cb, 97002f4034894aef89e2d21f860e72c1; no voters:
I20260810 03:50:05.121659 16318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.121791 16318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:05.121771 16304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 03:50:05.122041 16304 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [term 1 LEADER]: Becoming Leader. State: Replica: 8b817639f5114048b4e11e5e031e56cb, State: Running, Role: LEADER
I20260810 03:50:05.122432 16304 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } }
I20260810 03:50:05.124714 16304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b817639f5114048b4e11e5e031e56cb. Latest consensus state: current_term: 1 leader_uuid: "8b817639f5114048b4e11e5e031e56cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.127002 16304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: This master's current role is: LEADER
I20260810 03:50:05.130136 16295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b: No bootstrap required, opened a new log
W20260810 03:50:05.134289 16338 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:50:05.134462 16338 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:50:05.131031 16131 master_runner.cc:186] Error getting master registration for 127.22.134.252:38459: OK, instance_id { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" instance_seqno: 1786333805051796 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 03:50:05.135421 16131 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 03:50:05.137332 16295 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } }
I20260810 03:50:05.137707 16341 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 03:50:05.137681 16295 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1fae6fac9934fadb545c8a7c82f0d6b, State: Initialized, Role: FOLLOWER
I20260810 03:50:05.138131 16295 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } }
I20260810 03:50:05.138839 16341 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 03:50:05.139793 16295 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 03:50:05.139889 16266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b817639f5114048b4e11e5e031e56cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b"
I20260810 03:50:05.140133 16266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [term 0 FOLLOWER]: Advancing to term 1
I20260810 03:50:05.141669 16266 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b817639f5114048b4e11e5e031e56cb in term 1.
I20260810 03:50:05.146893 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.120650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52784 (local address 127.22.134.254:38329)
0810 03:50:05.120832 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.120839 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.121590 (+ 751us) server_negotiation.cc:407] Connection header received
0810 03:50:05.121981 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.122012 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.122082 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.122150 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.124636 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.125494 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.133156 (+ 7662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.133576 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.133699 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.143059 (+ 9360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.143063 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.143066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.143097 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.144957 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.145511 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.145517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.145519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.145609 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.145903 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.145907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.145909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.146128 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.146246 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.146599 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.146727 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 03:50:05.152953 16266 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [term 1 FOLLOWER]: Refusing update from remote peer 8b817639f5114048b4e11e5e031e56cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:50:05.153702 16304 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 03:50:05.154311 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.121115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59450 (local address 127.22.134.252:38459)
0810 03:50:05.121246 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.121251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.123362 (+ 2111us) server_negotiation.cc:407] Connection header received
0810 03:50:05.123548 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.123551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.123601 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.123654 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.124625 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.125477 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.126711 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.127052 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.127130 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.142606 (+ 15476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.142611 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.142614 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.142648 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.145003 (+ 2355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.152322 (+ 7319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.152325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.152327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.152440 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.152895 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.152899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.152901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.153309 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.153465 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.153969 (+ 504us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.154125 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:50:05.155412 16209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:05.123190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42002 (local address 127.22.134.253:36277)
0810 03:50:05.123310 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.123315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.132788 (+ 9473us) server_negotiation.cc:407] Connection header received
0810 03:50:05.132843 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.132846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.132902 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.133007 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.142194 (+ 9187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.143636 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.149231 (+ 5595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:05.149589 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:05.149670 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:05.151461 (+ 1791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 03:50:05.151465 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 03:50:05.151468 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 03:50:05.151495 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 03:50:05.153308 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.153953 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.153957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.153958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.154044 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 03:50:05.154353 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 03:50:05.154357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 03:50:05.154358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 03:50:05.154574 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 03:50:05.154670 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:05.155122 (+ 452us) server_negotiation.cc:299] Negotiation successful
0810 03:50:05.155259 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 03:50:05.161005 16343 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b817639f5114048b4e11e5e031e56cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.161226 16343 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:05.161353 16343 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b817639f5114048b4e11e5e031e56cb. Latest consensus state: current_term: 1 leader_uuid: "8b817639f5114048b4e11e5e031e56cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.161464 16343 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:05.161809 16178 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [term 1 FOLLOWER]: Refusing update from remote peer 8b817639f5114048b4e11e5e031e56cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 03:50:05.162465 16337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8b817639f5114048b4e11e5e031e56cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.162631 16337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: This master's current role is: LEADER
I20260810 03:50:05.162774 16358 mvcc.cc:205] Tried to move back new op lower bound from 7316823265897201664 to 7316823265786146816. Current Snapshot: MvccSnapshot[applied={T|T < 7316823265897201664}]
I20260810 03:50:05.164590 16304 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 03:50:05.164913 16356 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 03:50:05.165024 16356 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 03:50:05.165583 16359 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8b817639f5114048b4e11e5e031e56cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.165714 16359 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:05.167762 16341 catalog_manager.cc:1347] Generated new cluster ID: 7e2fba481f394328b960d0271e522f86
I20260810 03:50:05.167835 16341 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 03:50:05.171406 16318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b817639f5114048b4e11e5e031e56cb. Latest consensus state: current_term: 1 leader_uuid: "8b817639f5114048b4e11e5e031e56cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.171545 16318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:05.171630 16318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8b817639f5114048b4e11e5e031e56cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.171694 16318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 03:50:05.185446 16341 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 03:50:05.187844 16366 mvcc.cc:205] Tried to move back new op lower bound from 7316823265897201664 to 7316823265786146816. Current Snapshot: MvccSnapshot[applied={T|T < 7316823265897201664}]
I20260810 03:50:05.188897 16341 catalog_manager.cc:1504] Loading token signing keys...
I20260810 03:50:05.197315 16304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8b817639f5114048b4e11e5e031e56cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b817639f5114048b4e11e5e031e56cb" member_type: VOTER last_known_addr { host: "127.22.134.254" port: 38329 } } peers { permanent_uuid: "97002f4034894aef89e2d21f860e72c1" member_type: VOTER last_known_addr { host: "127.22.134.253" port: 36277 } } peers { permanent_uuid: "f1fae6fac9934fadb545c8a7c82f0d6b" member_type: VOTER last_known_addr { host: "127.22.134.252" port: 38459 } } }
I20260810 03:50:05.197499 16304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb [sys.catalog]: This master's current role is: LEADER
I20260810 03:50:05.205595 16341 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b817639f5114048b4e11e5e031e56cb: Generated new TSK 0
I20260810 03:50:05.206560 16341 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 03:50:05.243431 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.240167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42014 (local address 127.22.134.253:36277)
0810 03:50:05.240308 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.240313 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.242176 (+ 1863us) server_negotiation.cc:407] Connection header received
0810 03:50:05.242399 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.242403 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.242458 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.242531 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.243258 (+ 727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42014: BlockingRecv error: recv got EOF from 127.0.0.1:42014 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 03:50:05.245335 16128 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.241164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52786 (local address 127.22.134.254:38329)
0810 03:50:05.241300 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.241307 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.244027 (+ 2720us) server_negotiation.cc:407] Connection header received
0810 03:50:05.244444 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.244448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.244517 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.244575 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.245208 (+ 633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52786: BlockingRecv error: recv got EOF from 127.0.0.1:52786 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260810 03:50:05.246542 16301 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.241552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59454 (local address 127.22.134.252:38459)
0810 03:50:05.241668 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.241673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.244353 (+ 2680us) server_negotiation.cc:407] Connection header received
0810 03:50:05.245719 (+ 1366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.245723 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.245778 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.245833 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.246381 (+ 548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59454: BlockingRecv error: recv got EOF from 127.0.0.1:59454 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260810 03:50:05.251780 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.250036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42016 (local address 127.22.134.253:36277)
0810 03:50:05.250154 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.250158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.250715 (+ 557us) server_negotiation.cc:407] Connection header received
0810 03:50:05.250955 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.250959 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.251043 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.251103 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.251665 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42016: BlockingRecv error: recv got EOF from 127.0.0.1:42016 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260810 03:50:05.256949 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.255272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42030 (local address 127.22.134.253:36277)
0810 03:50:05.255377 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.255382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.255954 (+ 572us) server_negotiation.cc:407] Connection header received
0810 03:50:05.256151 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.256154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.256206 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.256260 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.256836 (+ 576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42030: BlockingRecv error: recv got EOF from 127.0.0.1:42030 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260810 03:50:05.262814 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.261104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42040 (local address 127.22.134.253:36277)
0810 03:50:05.261219 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.261224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.261805 (+ 581us) server_negotiation.cc:407] Connection header received
0810 03:50:05.262014 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.262018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.262072 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.262128 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.262698 (+ 570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42040: BlockingRecv error: recv got EOF from 127.0.0.1:42040 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260810 03:50:05.270989 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.269146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42050 (local address 127.22.134.253:36277)
0810 03:50:05.269307 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.269312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.269941 (+ 629us) server_negotiation.cc:407] Connection header received
0810 03:50:05.270158 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.270163 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.270220 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.270277 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.270865 (+ 588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42050: BlockingRecv error: recv got EOF from 127.0.0.1:42050 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260810 03:50:05.283418 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.281589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42064 (local address 127.22.134.253:36277)
0810 03:50:05.281721 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.281726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.282348 (+ 622us) server_negotiation.cc:407] Connection header received
0810 03:50:05.282582 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.282586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.282646 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.282707 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.283292 (+ 585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42064: BlockingRecv error: recv got EOF from 127.0.0.1:42064 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 03:50:05.304167 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.302209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42076 (local address 127.22.134.253:36277)
0810 03:50:05.302355 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.302361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.303042 (+ 681us) server_negotiation.cc:407] Connection header received
0810 03:50:05.303274 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.303278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.303338 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.303398 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.304034 (+ 636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42076: BlockingRecv error: recv got EOF from 127.0.0.1:42076 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 03:50:05.340627 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.339039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42092 (local address 127.22.134.253:36277)
0810 03:50:05.339180 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.339185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.339387 (+ 202us) server_negotiation.cc:407] Connection header received
0810 03:50:05.339561 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.339566 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.339674 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.339783 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.340495 (+ 712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42092: BlockingRecv error: recv got EOF from 127.0.0.1:42092 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 03:50:05.408169 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.406967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42094 (local address 127.22.134.253:36277)
0810 03:50:05.407188 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.407192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.407311 (+ 119us) server_negotiation.cc:407] Connection header received
0810 03:50:05.407447 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.407449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.407497 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.407570 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.408040 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42094: BlockingRecv error: recv got EOF from 127.0.0.1:42094 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260810 03:50:05.539907 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.538445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42096 (local address 127.22.134.253:36277)
0810 03:50:05.538620 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.538626 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.538773 (+ 147us) server_negotiation.cc:407] Connection header received
0810 03:50:05.538968 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.538972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.539040 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.539150 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.539779 (+ 629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42096: BlockingRecv error: recv got EOF from 127.0.0.1:42096 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260810 03:50:05.799567 16209 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 03:50:05.798263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42098 (local address 127.22.134.253:36277)
0810 03:50:05.798428 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:05.798432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:05.798490 (+ 58us) server_negotiation.cc:407] Connection header received
0810 03:50:05.798627 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:05.798630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:05.798680 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:05.798755 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 03:50:05.799411 (+ 656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42098: BlockingRecv error: recv got EOF from 127.0.0.1:42098 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 03:50:06.135927 16338 catalog_manager.cc:1259] Loaded cluster ID: 7e2fba481f394328b960d0271e522f86
I20260810 03:50:06.136024 16338 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1: loading cluster ID for follower catalog manager: success
I20260810 03:50:06.137717 16338 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1: acquiring CA information for follower catalog manager: success
I20260810 03:50:06.138854 16338 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 97002f4034894aef89e2d21f860e72c1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:50:06.166568 16356 catalog_manager.cc:1259] Loaded cluster ID: 7e2fba481f394328b960d0271e522f86
I20260810 03:50:06.166666 16356 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b: loading cluster ID for follower catalog manager: success
I20260810 03:50:06.168319 16356 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b: acquiring CA information for follower catalog manager: success
I20260810 03:50:06.169581 16356 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f1fae6fac9934fadb545c8a7c82f0d6b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 03:50:06.318080 16449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:06.313869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42112 (local address 127.22.134.253:36277)
0810 03:50:06.314171 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:06.314174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:06.314190 (+ 16us) server_negotiation.cc:407] Connection header received
0810 03:50:06.314276 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:06.314280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:06.314457 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:06.314578 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:06.314847 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.315478 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.316393 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.316619 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.316711 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:06.317156 (+ 445us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:06.317683 (+ 527us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:06.317778 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:06.317897 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 03:50:06.317949 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":104,"threads_started":1}
I20260810 03:50:06.325369 16456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:06.321478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59468 (local address 127.22.134.252:38459)
0810 03:50:06.321736 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:06.321741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:06.321756 (+ 15us) server_negotiation.cc:407] Connection header received
0810 03:50:06.321879 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:06.321882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:06.322010 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:06.322143 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:06.322364 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.322886 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.323728 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.323971 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.324083 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:06.324394 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:06.324933 (+ 539us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:06.325086 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:06.325133 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 03:50:06.325193 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":94,"threads_started":1}
I20260810 03:50:06.333438 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:06.328566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52788 (local address 127.22.134.254:38329)
0810 03:50:06.328857 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:06.328863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:06.329217 (+ 354us) server_negotiation.cc:407] Connection header received
0810 03:50:06.329351 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:06.329356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:06.329547 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:06.329685 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:06.330133 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.330975 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.331892 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.332155 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.332256 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:06.332614 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:06.333023 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:06.333141 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:06.333215 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 03:50:06.333274 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":84,"threads_started":1}
I20260810 03:50:06.333415 16449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:06.328687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42114 (local address 127.22.134.253:36277)
0810 03:50:06.328848 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:06.328853 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:06.329502 (+ 649us) server_negotiation.cc:407] Connection header received
0810 03:50:06.329672 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:06.329681 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:06.329768 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:06.329859 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:06.330115 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.330784 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.332175 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.332488 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.332594 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:06.332841 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:06.332919 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:06.332994 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:06.333175 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 03:50:06.333250 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 03:50:06.333971 16456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 03:50:06.329061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59476 (local address 127.22.134.252:38459)
0810 03:50:06.329179 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 03:50:06.329184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 03:50:06.329526 (+ 342us) server_negotiation.cc:407] Connection header received
0810 03:50:06.329756 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 03:50:06.329760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 03:50:06.329826 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 03:50:06.329905 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 03:50:06.330307 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.331051 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.332324 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 03:50:06.332689 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 03:50:06.332810 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 03:50:06.333259 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 03:50:06.333342 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 03:50:06.333392 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 03:50:06.333749 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 03:50:06.333820 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 03:50:06.342346 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 16043
I20260810 03:50:06.351725 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 16131
I20260810 03:50:06.360309 23067 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWYy72V/build/debug/bin/kudu with pid 16214
2026-08-10T03:50:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3269 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6542 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (304271 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST